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In  decision  analysis  we  normally  con  aider- the - va 1 ue  of -in format ion  to  be  a 
constant  against  which  the  cost  of  information  is  compared.  However,  when 
it  is  possible  to  buy  information  sequentially,  the  value  of  information  is 
not  a  constant.  Rather,  it  is  a  function  of  the  prices  of  the  various  pieces 
of  information,  or  "observables."  When  we  are  faced  with  a  decision  and  learn 
one  observable,  this  information  not  only  helps  us  make  the  original  decision, 
but  also  helps  US  decide  if  we  should  pay  for  more  nhservahlfts.  For  this 
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reason,  the  first  observable  has  a  valu-j  above  and  beyond  that  which  we  would 
assign  if  there  were  no  possibility  of  obtaining  additional  information. 

As  the  cost  of  one  observable  is  increased,  the  value  of  information  about 
another  observable  can  decrease  or  remain  constant.  In  lict,  the  derivative 
of  the  value  of  information  about  one  observable  with  respect  to  the  cost  of 
another  observable  must  lie  in  the  closed  interval  [-1,0]  .  The  second 

derivative  of  the  value  of  information  with  respect  to  the  price  of  any  ob¬ 
servable  cannot  be  negative. 

Since  the  value  of  information  is  a  function  of  the  prices  of  the  observables, 
it  is  necessary  to  know  the  prices  of  all  the  observables  before  deciding 
whether  or  not  to  pay  for  a  single  piece  of  information.  If  we  know  the 
price  of  every  observable,  we  can  determine  which,  if  any,  we  should  buy 
first.  In  this  manner,  we  can  divide  the  set  of  all  possible  n-tuples  of 
observable  prices  into  mutally-exclusive  end  collectively-exhaustive  subsets 
such  that  our  best  initial  decision  is  to  buy  the  ith  observable  when  the 
n-tuplo  of  prices  is  contained  in  the  i^h  subset.  The  subsets  can  be  viewed 
as  regions  in  the  n-dimensional  Euclidean  space  spanned  by  the  prices;  we 
can  approximate  or  bound  the  regions. 

If  the  prices  of  the  observables  are  uncertain,  the  value  of  information  is 
a  function  of  our  state  of  information  about  the  prices.  If  we  assume  that 
the  prices  are  independent  random  variables,  the  value  of  information  is  a 
function  of  the  expected  prices  with  the  same  functional  form  that  would  re¬ 
sult  if  the  prices  were  certain.  If  the  cost  of  learning  an  observable 
changes  after  other  observables  are  purchased,  the  value  of  information  then 
depends  on  all  of  the  possible  prices. 
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tue  derivative  of  the  value  of  information  about  one  observable  with 
respect  to  the  cost  of  another  observable  must  lie  in  the  closed  inter¬ 
val  [-1,0]  .  The  second  derivative  of  the  value  of  information  with 
respect  to  the  price  of  any  observable  cannot  be  negative. 

Since  the  value  of  information  is  a  function  of  the  prices  of  the 
observables,  it  is  necessary  to  know  the  prices  of  all  the  observables 
before  deciding  whether  or  not  to  pay  for  a  single  piece  of  information. 
If  we  know  the  price  of  every  observable,  we  can  determine  which,  if  any, 
we  should  buy  first.  In  this  manner,  we  can  divide  the  set  of  all  pos¬ 
sible  n- tuples  of  observable  prices  into  mutually-exclusive  and 
collectively-exhaustive  subsets  such  that  our  best  initial  decision  is 
to  buy  the  ith  observable  when  the  n- tuple  of  prices  is  contained  in 
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the  1th  subset.  The  subsets  can  be  viewed  as  regions  in  the  n- dimensional 
Euclidean  space  spanned  by  the  prices;  we  can  approximate  or  bound  the 
regions . 

If  the  prices  of  the  observables  are  uncertain,  the  value  of  infor¬ 
mation  is  a  function  of  our  state  of  information  about  the  prices.  If 
we  assume  chat  the  prices  are  independent  random  variables,  the  value 
of  information  is  a  function  of  the  expected  prices  with  the  same  func¬ 
tional  form  that  would  result  if  the  prices  were  certain.  If  the  cost 
of  learning  an  observable  changes  after  other  observables  are  purchased, 
the  value  of  information  then  depends  on  all  of  the  possible  prices. 
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CHAPTER  1 


INTRODUCTION 

In  decision  analysis,  [6 , 11 , 12 , 13] *  we  customarily  think  of  the  value 
of  a  piece  of  information  as  being  a  fixed  amou-  t  against  which  we  should 
compare  the  cost  of  learning  the  information.  We  should  refuse  to  pay 
for  the  information  if  its  cost  exceeds  its  value.  Otherwise  we  can  ex¬ 
pect  to  gain,  in  some  statistical  sense,  by  paying  for  the  information. 

It  is  possible  to  extend  this  simple  idea  by  incorporating  the  concepts 
of  risk  preference,  utility  functions,  and  imperfect  information.  How¬ 
ever  the  basic  concept  remains  the  same.  In  principle  we  can  determine 
a  fixed  maximum  price  that  we  should  pay  for  a  piece  of  information,  and 
then  use  this  quantity,  which  we  call  the  value  of  the  information,  u> 
decide  whether  or  not  to  buy  the  information. 

Conclusions  and  Contributions 

Unfortunately,  as  the  following  chapters  will  show,  this  straight¬ 
forward  notion  of  the  value  of  information  is  inadequate.  When  we  have 
the  option  of  buying  a  piece  of  information--which  we  call  an  "observ- 
able"--and  studying  it  before  deciding  whether  or  not  to  pay  for  addi¬ 
tional  information,  the  value  of  the  information  is  greater  than  it  would 
be  if  we  could  buy  only  the  observable  by  itself.  When  information  is 
available  sequentially,  we  must  consider  the  prices  of  all  of  the  observ¬ 
ables  in  order  to  decide  whether  or  not  to  pay  for  any  individual 

* 

Numbers  in  square  brackets  refer  to  the  Bibliography. 
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observable.  In  other  words,  the  value  of  information,  rathei  than  being 
a  constant,  is  a  function  of  the  prices  of  all  of  the  other  observables 
that  we  might  decide  to  buy. 

This  idea,  which  will  be  explored  in  some  detail  in  the  following 
chapters,  is  one  of  the  general  conclusions  and  contributions  of  this 
paper.  We  can  state  this  conclusion  more  precisely  with  the  following 
definitions.  If  there  are  n  observables  that  we  could  learn  sequen¬ 
tially,  then  we  can  define  n  random  variables  (y^,  ....  yn)  such  that 
learning  the  iC^  piece  of  information  is  equivalent  to  learning  the 
actual  value  cf  y^  .  Since  learning  y^  is  equivalent  to  learning  the 
i^  piece  of  in  ormation,  we  shall  call  y^  the  ifc^  observable.  Let 

and  be  the  cost  and  value,  respectively,  of  the  i^  observ¬ 

able.  Using  these  definitions,  the  conclusion  stated  above  becomes: 


1. 


In  general,  is  a  function  of  the  prices  of  all  of  the 

observables  except  K  .  Thus 

yi 


V  <K  , 

yt  yi’ 


For  simplicity  we  sometimes  write  the  extected  value  of  sequential  infor¬ 
mation  about  y±  as  V^OC^,  • • • »  Ky  >  *  where  lt  is  understood  that 
V  does  not  depend  on  K  .  Since  our  decisions  to  pay  for  or  refuse 

yt  yi 

the  information  represented  by  y^  depends  on  the  relative  values  of 

K  and  V  ,  we  will  have  to  know  all  of  the  prices  including  K 
Yi  Vi  yl 

before  we  can  make  the  decision.  The  method  used  to  determine  the  value 

function  V  (K  ,  K  )  is  demonstrated  in  the  following  chapters. 

yi  yl  yn 

If  the  value  of  a  piece  of  information  is  a  function  of  the  prices 


of  all  of  the  other  observables,  what  can  we  say  about  the  form  of  this 
function?  If  the  decision  maker's  utility  function  has  certain  proper¬ 
ties,  we  can  show  that: 

2.  Increasing  any  one  of  the  prices  of  the  observables  will 

cause  the  value  of  a  piece  of  information  to  remain  constant 
or  decrease.  However  the  value  of  the  information  cannot 
decrease  by  more  than  the  amount  that  the  price  increases. 

In  other  words, 


av 

Tk~  (Kyi*  *•••  Kyi_i’  Kyi+i . Kyn)  €  [“1,0] 

yj 


This  result,  and  those  that  follow,  hold  for  any  decision  maker  who  has 
a  utility  function  that  satisfies  the  delta  property  and  is  monotonically 
increasing  (the  delta  property  is  discussed  in  the  next  section).  It  is 
possible  for  dVy^/dK^  to  equal  any  value  between  -1  and  0  ,  so  that 
increasing  a  price  by  one  unit  can  cause  the  value  of  some  observables 
to  drop  by  a  fraction  of  a  unit. 

We  can  go  one  step  further  and  show  that  9V  /SK  must  increase  or 

yi  yj 

remain  constant  when  K  increases: 

yj 

3.  Increasing  any  one  of  the  prices  will  cnuse  the  rate  of  change 
of  the  value  of  any  observable  with  respect  to  that  price  to 
increase  or  remain  constant.  In  other  words, 


32V 


*  <K  .  •••.  K 


3K  -  yl 

yj 


,  K 


. K  )  >  0 

IT  — 


yi-l  yi+l  ■'n 

It  is  possible  for  the  first  derivative  to  be  discontinuous, 


3 


and  for  the  second  derivative  to  be  infinite.  However,  it  need  not  be 


true  that 


a2v 


dK  dK 
yj  yk 


i  0 


It  is  possible  for  dV  /dK.  to  make  a  discontinuous  jump  to  a  lower 

K  yi  yj 

value  as  K  is  increased. 

Vk 

We  can  write  a  general  expression  for  the  value  function 
V  (K  .....  K  )  as  shown  in  Chapter  4.  However,  this  expression  is 

yi  yi  yn 

not  useful  for  solving  practical  problems  since  it  is  written  as  a  series 
of  maximizations.  For  any  given  problem  we  can  carry  out  a  number  of 
calculations  to  determine  algebraic  expressions  for  the  value  functions 
that  do  not  involve  maximization.  Using  these  expressions  we  can  deter¬ 
mine  which  observable,  if  any,  we  should  buy  first  for  any  given  set  of 
prices,  (K  ,  K  )  .  In  this  manner  we  can  divide  the  set  of  all 

yi  y« 

possible  n- tuples  of  prices  into  subsets,  such  that  when  the  n- tuple  of 
prices  is  in  the  i^  subset,  our  best  initial  decision  is  to  buy  the 
i^  observable.  Thus: 

4.  It  is  possible  to  determine  (tril)  mutually  exclusive  and 

collectively  exhaustive  set6  for  i  ■  0,1 . n  ,  such 

that  when 

(KyL »  •  •  •  »  €  ^i 

our  best  Initial  decision  is  to  buy  the  i^  piece  of 
intormatlon.  If  i  equals  zero,  our  best  decision  is  to 
refuse  all  the  information.  We  can  visualize  the  as 
decision  regions  in  the  n-dimensional  Euclidean  space  spanned 
by  the  prices  (K  . K  )  . 

yi  yn 


4 


Unfortunately  a  large  number  cf  calculations  are  required  to  deter¬ 
mine  the  value  functions  when  there  are  more  than  two  or  three  pieces  of 
sequential  information  available.  It  will  be  shown  in  Chapter  4  that  the 
number  of  calculations  increases  like  2°  ,  where  n  is  the  number  of 
sequential  pieces  of  information.  However,  even  when  the  number  of  cal¬ 
culations  required  to  determine  the  value  functions  and  the  decision  sets, 
ni  ,  become  prohibitively  large,  we  can  determine  certain  properties  of 
these  functions  and  sets  by  carrying  out  a  relatively  small  number  of 
calculations.  In  particular: 

5.  It  is  possible  to  approximate  the  decision  sets  by  solvinc 
the  appropriate  decision  tree  using  several  sets  of  prices 
for  the  observables.  Also,  there  exists  a  maximum  price  that 
we  are  willing  to  pay  for  each  observable  when  our  best  ini¬ 
tial  decision  is  to  buy  that  observable.  It  is  possible  to 
bound  this  maximum  price. 

One  bound  that  works  for  all  sequential^  information  problems  is  the  value 
of  learning  simultaneously  all  of  the  observables  that  are  available. 

This  constant  is  relatively  easy  to  calculate  and  it  bounds  the  maximum 
initial  value  of  every  piece  of  information.  For  certain  problems  it  is 
possible  to  find  tighter  bounds  with  a  little  more  effort;  the  procedures 
for  doing  so  will  be  discussed  in  the  following  chapters. 

Utility  and  Risk  Preference 

We  assume  throughout  this  paper  that  the  decision  maker  always  pre¬ 
fers  more  money  to  less  money.  In  other  words,  his  utility  function 
[5,9,10,151  must  be  monotonically  increasing.  The  conclusions  stated 
previously  are  based  on  this  assumption. 
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We  have  defined  the  value  of  information  as  the  maximum  price  that  we 
are  willing  to  pay  for  the  information.  It  is  difficult  to  determinr  this 
maximum  price  unless  the  decision  maker's  utility  function  has  certain 
properties.  For  an  arbitrary  utility  function  it  is  necessary  to  compare 
the  expected  utilities  that  result  when  we  learn  and  do  not  learn  the  in¬ 
formation,  and  then  vary  the  price  of  the  information  until  the  two  expected 
utilities  are  the  same.  For  simple  problems,  it  is  possible  to  solve  an 
equation  for  the  maximum  price,  but  for  more  difficult  problems  the  result 
is  often  determined  by  trial  and  error. 

This  difficulty  can  be  overcome  if  the  decision  maker's  riak  prefer¬ 
ence  can  be  represented  by  a  utility  function  that  satisfies  the  "delta 
property."  The  delta  property  implies  that  adding  a  given  amount  to  the 
value  of  all  of  the  possible  outcomes  associated  with  any  lottery  Increases 
the  certain  equivalent  of  the  lottery  by  exactly  the  same  amount.  The  cer¬ 
tain  equivalent  is  that  value  whose  utility  is  equal  to  the  expected  utility 
of  the  lottery.  Mathematically  the  delta  property  requires  that  the  utility 
function  U(.)  satisfy 

U(x  +  A)  -  crtJCx^  +  A)  +  (1  -  a)  U(x2  +  A) 

whenever 

U(x)  -  crtKxj^  +  (1  -  a)  U(x2) 

x  is  the  certain  equivalent  of  this  lottery.  This  must  hold  for  all  x^  , 
x2  ,  f.nd  A  ,  and  all  qc[0,1]  .  It  can  be  shown,  [5,10],  that  all  utility 
functions  that  satisfy  the  delta  property  have  one  of  the  following  forms: 

U(x)  “  A  +  Bx 
U(x)  -  A  +  Be"7* 
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The  first  of  these  utility  functions,  with  A  =  0  and  B  =  1  ,  corresponds 
to  a  decision  maker  who  attempts  to  maximize  his  expected  profit  in  ar  un¬ 
certain  situation.  We  call  such  a  person  an  expected-profit  or  risk- 
indifferent  decision  maker.  (As  long  as  B  is  positive,  the  firs*-  utility 
function  can  always  be  used  to  represent  an  expected-profit  decision  maker. 
Maximizing  the  first  utility  function  with  B  positive  is  equivalent  to 
maximizing  expected  profit.)  The  second  utility  function  can  represent  a 
risk-averse  or  risk-preferring  decision  maker. 

With  the  exception  of  the  last  part  of  Chapter  4,  the  following  dis¬ 
cussion  is  presented  in  terms  of  an  expected-profit  decision  maker.  How¬ 
ever,  it  will  be  shown  that  the  general  conclusions  stated  previously  are 
valid  as  long  as  the  decision  maker  has  a  utility  function  that  satisfies 
the  delta  property  and  is  mono  ton  ica’.ly  increasing. 

When  the  utility  function  satisfies  the  delta  property,  the  calcula¬ 
tions  required  to  determine  the  value  functions  V  (K  ,  . .  K  )  are 

y±  n  yn 

not  significantly  longer  or  more  difficult  than  those  required  for  an 
expected-profit  decision  maker.  In  this  case  the  value  of  a  piece  of 
information  can  be  determined  by  taking  the  difference  of  certain  equiva¬ 
lents.  On  the  other  hand,  when  the  utility  function  does  not  satisfy  the 
delta  property,  the  calculations  required  to  determine  the  value  functions 
become  very  long  and  difficult. 

Individual,  Simultaneous,  and  Sequential  Information 

When  there  is  more  than  one  piece  of  information  that  we  can  learn, 
we  can  have  the  option  of  learning  the  information  individually,  simulta¬ 
neously,  or  sequentially.  As  we  shall  see,  a  piece  of  informacion  can 
have  different  values  depending  on  how  we  decide  to  learn  it.  For  this 
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reason  we  represent  the  values  of  Individual,  simultaneous,  and  sequential 
information  with  different  symbols. 


If  we  decide  to  learn  an  individual  piece  of  information  and  refuse 
all  of  the  remaining  information,  the  maximum  price  that  we  are  willing  to 
pay  is  ,  where  y.  is  the  observable  we  are  learning.  is  called 

y±  1  y± 

the  value  of  individual  information  about  the  observable  y^  .  In  this 
work  a  value  of  information  with  a  superscript  N  means  that  the  value  is 
determined  by  assuming  that  no  additional  information  will  be  purchased  be¬ 
yond  that  shown  in  »:he  subscript. 

On  the  other  hand  we  could  decide  to  learn  several  pieces  of  informa¬ 
tion  simultaneously.  In  this  case  we  would  receive  all  of  the  information 
at  once  without  an  opportunity  to  look  at  one  observable  before  deciding 
whether  or  not  to  pay  for  another.  If  we  learn  two  observables  simulta¬ 


neously,  the  expected  value  of  learning  both  is 


yiyJ 


,  where  y^  and 


y  are  the  observables  we  are  learning.  V1*  is  called  the  value  of 

i  Vj 

simultaneous  information  about  yi  and  y^  .  If  there  are  three  pieces 
of  information,  the  expected  value  of  learning  all  three  simultaneously  is 
V**  ,  and  so  on.  Again,  the  superscript  N  means  that  no  additional 

yi/jyk 

information  will  be  purchased. 

V  and  VN  are  constants  that  do  not  depend  on  the  cost  of  any 

yi  yiyj 

observable.  We  might  expect  the  value  of  learning  two  pieces  of  information 
simultaneously  to  equal  the  sum  of  the  values  of  learning  them  individually. 
In  other  words,  we  might  expect  to  equal  the  sum  of  and  V**  . 

yiyJ  „  yi  yj 

However,  this  is  not  generally  true.  It  is  possible  for  \T  ^  to  be 
greater  or  less  than  the  sum  of  and  .  (Similar  statements  can 

yi  yJ 

be  made  when  there  are  more  than  two  observables.  For  example,  it  is 
possible  for  V**  to  be  greater  or  less  than  the  sum  of  v"  ,/  , 

yiyjyk  yi  yj 


and 


V» 

* 


y  .  )  This  can  be  demonstrated  with  two  simple  decision  problems. 
7k 
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Decision  Problem  One:  Suppose  we  have  an  opportunity  to  play  the  fol¬ 
lowing  game.  A  fair  coin  will  be  flipped  twice,  an!  we  will  win  ten  dollars 
if  we  can  correctly  predict  whether  or  not  the  two  outcomes  will  be  the 
same.  It  is  easy  to  see  that  our  expected  profit  in  the  absence  of  any 
information  about  the  outcomes  of  the  two  flips  is  five  dollars.  Now  sup¬ 
pose  that  a  reliable  clairvoyant  offers  to  tell  us  the  outcome  of  either 


or  both  flips.  ^  How  much  is  his  information  worth  to  us  if  we  are  trying 

\ 

to  maximize  our  expected  profit? 

\ 

Wc  have  an  Opportunity  to  learn  two  different  pieces  of  information, 

I 

so  there  are  two  observables  in  this  problem.  Let  y  (i  =  1,2)  be  a 
random  variable  such  that  y±  equals  zero  if  the  outcome  of  the  ith  flip 
is  a  tail,  and  y^  equals  one  if  the  outcome  of  the  ith  flip  is  a  head. 
If  we  decide  to  learn  yt  only,  our  expected  profit  after  receiving  the 
information  is  still  five  dollars.  Since  learning  y 1  does  not  increase 
our  expected  profit,  equals  zero.  Similarly,  V**  equals  zero.  On 

the  other  hand,  if  we  decide  to  learn  both  y^  and  y 2  ,  we  will  know 
whether  or  not  the  two  outcomes  are  the  same  and  our  expected  profit  will 
be  ten  dollars.  Since  learning  both  observables  increases  our  expected 
profit  by  five  dollars,  /  equals  five  dollars.  Thus  VN  exceeds 

71  yo  \T  \r 


yly2 


yiy2 

the  sum  of  and  vJJ  for  this  problem. 

*1  y2 

Decision  Problem  Two:  Suppose  we  have  an  opportunity  to  play  the  fol¬ 
lowing  game.  We  make  a  single  prediction  of  either  heads  or  tails,  and  then 
a  fair  coin  is  flipped  twice.  We  are  given  ten  dollars  each  time  the  out¬ 
come  of  a  flip  agrees  with  our  prediction.  However,  we  cannot  predict 
heads  on  one  flip  and  tails  on  the  other.  In  the  absence  of  any  informa¬ 
tion  about  the  outcomes  of  the  two  flips,  our  expected  profit  is  ten  dol¬ 
lars.  Now  suppose  that  the  reliable  clairvoyant  again  offers  to  tell  us 


> 
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the  outcome  of  either  or  both  flips.  How  much  is  his  information  worth 
this  time? 

Let  yL  and  y2  be  the  two  observables,  as  in  the  previous  decision 
problem.  If  we  decide  to  learn  yt  only,  we  will  predict  the  outcome  that 
the  clairvoyant  says  will  occur.  This  means  that  we  are  certain  to  re¬ 
ceive  ten  dollars  for  correctly  predicting  the  first  flip,  and  we  have  an 
expected  profit  of  five  dollars  from  the  second  flip.  Thus  our  total  ex¬ 
pected  profit  increases  to  fifteen  dollars,  and  V1^  equals  five  dollars. 

Similarly,  V**  equals  five  dollars.  On  the  other  hand,  if  we  decide  to 
y2 

learn  both  yt  and  y2  ,  we  will  be  able  to  use  this  information  to  pre¬ 
dict  both  flips  correctly  and  collect  twenty  dollars  with  a  probability 
of  50%.  Otherwise  the  clairvoyant  will  tell  us  that  the  two  outcomes  are 
different,  and  we  will  only  be  able  to  make  ten  dollars,  in  this  case  our 
expected  profit  is  fifteen  dollars,  and  vj  y^  equals  five  dollars.  Thus 
Vs  is  less  than  the  sum  of  vJJ  and  vjj  for  this  decision  problem. 

y\y2  yi  y2 

These  simple  examples  show  that  our  intuition  does  not  lead  us  to  the 
correct  conclusion.  The  value  of  learning  several  pieces  of  information 
simultaneously  need  not  equal  the  sum  of  the  values  of  learning  each  piece 
of  information  individually.  LaValle  [7,8]  describes  this  situation  as 
being  "roughly  analogous  to  saying  that  the  whole  is  greater  than  the  sum 

of  its  parts." 

We  can  understand  this  situation  better  by  graphing  the  prices  for 
which  we  would  be  willing  to  buy  one  or  both  pieces  of  information  in  the 
two  simple  decision  problems.  Let  Ky  and  be  the  cost  of  learning 

the  actual  values  of  yt  and  y2  respectively.  Any  pair  of  prices 
(v  K  )  can  be  represented  by  a  point  in  a  two-dimensional  diagram  such 

yi’  yz 

as  those  shown  in  Figs.  1.1  and  1.2.  We  are  willing  to  buy  the  information 
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N 

corresponding  to  y  when  K  <  V  ,  the  information  corresponding  to 
H1  yi 

y .  when  K  <  V  ,  and  both  pieces  of  information  when  (K  +  K  )  < 

2  y2  -  y2  yi  'Si  ~ 

^  .  (It  is  possible  that  the  cost  of  learning  two  pieces  of  informa¬ 

tion  does  rot  equal  the  sum  of  the  costs  of  learning  each  individually. 

The  case  of  non-additive  prices  is  discussed  in  Chapter  5.  For  the  moment 
we  will  assume  that  the  prices  are  additive.) 

These  decision  rules  are  shown  in  Fig.  1.1  for  the  first  decision 
problem  and  Fig.  1.2  for  the  second  decision  problem.  In  the  first  deci¬ 
sion  problem  =  0  ,  so  we  will  only  accept  one  n4ece  of  informa¬ 
tion  by  itself  when  it  is  free.  However,  =  5  ,  so  we  are  willing 

yly2 

to  buy  both  pieces  of  information  simultaneously  whenever  their  prices  are 
represented  by  a  point  below  and  to  the  left  of  the  line  A-B  in  Fig.  1.1. 
Similarly,  in  the  second  decision  problem  we  are  willing  to  pay  K 

yi 

to  learn  y^^  for  any  pair  of  prices  represented  by  a  point  to  the  left  of 
the  line  E-F  in  Fig.  1.2.  We  are  also  willing  to  pay  to  learn  y ^ 

for  any  pair  of  prices  represented  by  a  point  below  the  line  C-D,  and  we 
are  willing  to  pay  (K  +  K  )  to  learn  both  pieces  of  information  for 

yl  y2 

any  pair  of  prices  below  and  to  the  left  of  the  line  C-E.  Actually  we 
would  do  better  to  buy  only  one  piece  of  information  for  any  pair  of  prices 
represented  by  a  point  within  the  triangle  0-C-E  since  the  second  piece  of 
information  cannot  raise  rur  expected  profit,  but  the  idea  here  is  that 
buying  both  pieces  of  information  is  preferable  to  not  buying  any  informa¬ 
tion  for  such  prices . 

The  interesting  thing  about  the  diagram  in  Fig.  1.1  is  that  there  are 
prices  represented  by  points  in  the  interior  of  the  triangle  O-A-B  such 
that  we  would  not  be  willing  to  buy  either  piece  of  information 
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individually  even  though  we  would  be  willing  to  buy  both  pieces  of 
information  simultaneously.  Pairs  of  prices  with  this  property  exist 
whenever  V^y2  exceeds  the  sum  of  and  . 

On  the  other  hand,  in  Fig.  1.2  there  are  pairs  of  prices  represented 
by  points  in  the  Interior  of  the  triangle  C-E-G  such  that  we  would  be  will¬ 
ing  to  buy  either  piece  of  information  individually,  but  we  would  not  be 
willing  to  buy  both  pieces  of  information  simultaneously.  Pairs  of  prices 


with  this  property  exist  whenever  vf  is  less  than  the  sum  of  V* 

r  r  y-^2  '  1 

and  v"  • 

The  two  decision  problems  have  the  same,  simple  probability  structuie. 
The  observables  y^  and  y2  are  independent  random  variables  with  the  same 
probability  mass  functions  in  bcch  problems.  The  only  thing  that  is  dif¬ 
ferent  in  the  two  problems  is  the  profit  function.  This  is  a  demonstration 
of  the  fact  that  the  relative  values  of  ,  and  are  not 

completely  determined  by  the  probability  structure  of  the  problem.  Many 
of  the  important  linkages  between  various  observables,  that  determine  the 
relative  value  of  each  observable,  occur  through  the  profit  function.  As 
we  shall  see  in  Chapter  2,  it  is  possible  for  the  random  variables  repre¬ 
senting  two  pieces  of  information  to  be  independent,  and  yet  the  value  of 
learning  one  observable  can  depend  on  the  other  observable.  This  dependence 
is  the  phenomenon  that  distinguishes  sequential  information  from  individual 


and  simultaneous  information. 

When  we  have  the  option  of  learning  information  sequentially,  we  can 
spread  our  decisions  out  in  time  and  evaluate  the  consequences  of  one  deci¬ 
sion  before  going  on  to  make  another.  Although  sequential  decisions  are 
inherently  spread  out  in  time,  we  will  assume  that  the  span  of  time  is 
short  enough  to  allow  us  to  ignore  the  effects  of  tine  preference,  such 


as  discounting.  Since  the  content  of  one  piece  of  information  can  affect 
the  value  of  another,  our  decision  to  learn  the  second  observable  can  vary 
with  what  we  learn  from  the  first.  Furthermore,  since  learning  one  ob¬ 
servable  can  cause  us  to  change  our  decision  about  learning  another,  the 
first  observable  has  a  value  above  and  beyond  the  value  that  we  would  deter¬ 
mine  by  considering  only  individual  and  simultaneous  purchases.  Any  time  a 
piece  of  information  can  affect  our  subsequent  decisions  it  is  valuable. 
However,  if  we  buy  all  of  our  information  at  once--either  an  individual 
purchase  or  the  simultaneous  purchase  of  several  pieces  of  information-- 
we  have  no  subsequent  decisions  to  make. 

In  terms  of  price  diagrams,  such  as  those  in  Figs.  1.1  and  1.2,  we 
shall  see  that  there  are  additional  decision  boundaries  corresponding  to 
the  decision  rules  for  buying  information  sequentially.  These  decision 
rules  are  not  as  simple  as  those  for  individual  and  simultaneous  information, 
and  the  decision  boundaries  in  the  price  diagram  can  be  described  by  com¬ 
plicated,  nonlinear  equations.  The  decision  boundaries  for  sequential  in¬ 
formation  will  usually  allow  us  to  purchase  information  at  sets  of  prices 
that  would  not  be  advantageous  if  we  considered  only  individual  and  simul¬ 
taneous  purchases  of  information.  Graphically  this  means  that  the  decision 
boundaries  for  sequential  information  can  lie  above  and  to  the  right  of  the 
corresponding  boundaries  for  individual  and  sequential  information,  such  as 
those  shown  in  Figs.  1.1  and  1.2.  This  fact  makes  the  question  of  whether 

or  not  VN  exceeds  the  sum  of  and  irrelevant.  In  most  deri¬ 

ve  yi  y2 

sion  problems  the  decision  about  how  much  informativ'n  to  purchase  will  be 
determined  by  the  value  of  sequential  information,  a  d  not  by  the  values  of 
individual  or  simultaneous  information.  This  idea  is  explored  in  some  detail 
in  the  following  chapters. 
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Different  Types  of  Sequential  Information  Problems 


It  is  possible  to  divide  sequential  information  problems  into  a  number 
of  categories.  Each  category  will  be  discussed  in  one  of  the  following 
chapters . 

When  the  two  simple  decision  problems  were  discussed  above,  it  w<»s 
assumed  that  the  cost  of  learning  two  observables  was  equal  to  the  sum  of 
the  costs  of  learning  each  observable  separately.  When  this  assumption  is 
valid  for  all  combinations  of  information  purchases,  we  say  that  the  prices 
are  additive.  However,  there  are  many  decision  problems  for  which  the 
prices  are  not  additive.  For  example,  if  we  set  up  a  research  program  to 
obtain  one  piece  of  information,  we  may  find  that  the  same  facilities  and 
expertise  can  be  used  to  learn  something  else.  In  this  case  we  can  obtain 
both  pieces  of  information  for  less  than  the  sum  of  the  costs  of  learning 
each  one  separately.  Consequently,  we  can  divide  all  sequential  decision 
problems  into  those  with  additive  and  non*addltive  prices. 

Another  distinction  based  on  the  cost  of  information  is  whether  or  not 
we  know  the  prices  with  certainty.  If  ve  do  not  know  exactly  what  it  will 
cost  to  learn  a  given  observable,  we  can  assess  our  uncertainty  about  the 
price  in  the  form  of  a  probability  density  function.  For  example,  we  might 
want  to  have  a  mechanic  test  out  automobile  to  see  if  anything  is  wrong 
with  it.  However,  before  the  mechanic  actually  does  the  work,  we  may  be 
uncertain  about  how  long  it  will  take  him  to  complete  the  test,  and  thus 
we  will  not  know  how  much  he  will  charge  us  for  his  labor.  In  a  case  like 
this,  we  will  have  to  incorporate  our  uncertainty  about  the  price  into  the 
determination  of  the  value  of  each  piece  of  information. 

Ve  can  also  distinguish  between  what  is  called  perfect  and  Imperfect 
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information.  Perfect  information  tells  us  the  exact  value  of  one  or  more 
of  the  arguments  of  the  profit  function.  In  other  words,  if  our  profit  de¬ 
pends  on  the  number  of  items  sold,  the  profit  per  item,  and  the  manufactur¬ 
ing  cost,  being  told  one  of  these  quantities  would  constitute  perfect  in¬ 
formation  about  that  quantity.  On  the  other  hand,  conducting  a  market  sur¬ 
vey  would  give  us  imperfect  information  since  it  would  change  our  state  of 
information  about  the  level  of  sales,  but  it  would  not  tell  us  exactly  how 
many  items  will  be  sold.  In  some  ways  the  distinction  between  perfect  and 
imperfect  information  is  artificial  because  all  information  ran  be  regarded 
as  perfect  information  about  something.  The  market  survey  tells  us  exactly 
what  percentage  of  the  group  interviewed  would  be  willing  to  buy  our  pro¬ 
duct.  We  shall  see  in  Chapter  3  that  the  same  problem  formulation  can  be 
used  for  perfect  and  imperfect  information.  However,  problems  that  deal 
only  with  perfect  information  can  be  formulated  in  a  simpler  manner,  and 
they  are  easier  to  understand.  For  this  reason  the  two  types  of  informa¬ 
tion  are  discussed  separately. 

The  following  chapter  deals  with  the  simplest  type  of  sequential  in¬ 
formation  problem:  the  case  of  additive,  certain  prices  for  perfect  informa¬ 
tion.  A  specific  decision  problem,  in  which  we  must  bid  for  a  contract,  is 
used  to  explain  the  effect  of  sequential  information  purchasing  and  to  show 

i 

the  procedure  used  to  determine  the  value  of  sequential  information.  Much 
of  the  notation  that  is  used  in  the  rest  of  the  work  is  developed  in 
Chapter  2. 

In  Chapter  3  a  problem  in  weather  forecasting  is  used  to  illustrate 
the  case  of  additive,  certain  prices  for  for  imperfect  information.  The 
close  relationship  between  problems  with  perfect  and  imperfect  information 
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is  discussed  at  the  end  of  Chapter  3.  Chapter  4  generalizes  the  procedures 
used  in  Chapters  2  and  3  for  additive,  certain  prices.  Several  proofs  are 
presented  in  Chapter  4  to  show  that  the  properties  of  the  value  of  se¬ 
quential  information  illustrated  in  Chapters  2  and  3  apply  to  all  sequential 
information  problems. 

Chapter  5  deals  with  the  case  of  uncertain  prices  by  extending  the 
bidding  example  introduced  in  Chapter  2.  We  show  that  under  certain  condi¬ 
tions  we  can  analyze  a  problem  with  additive,  uncertain  prices  by  assuming 
that  the  prices  are  equal  to  their  expected  values.  The  question  of  non¬ 
additive  prices  is  also  discussed  in  Chapter  5. 
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CHAPTER  2 


SEQUENTIAL  PERFECT  INFORMATION  WITH  ADDITIVE,  CERTAIN  PRICES: 

A  BIDDING  PROBLEM  REVISITED 

The  concepts  involved  in  the  value  of  sequential  perfect  information 
can  be  best  introduced  with  a  simple  example.  The  example  chosen  is  one 
discussed  in  some  detail  by  R.  A.  Howard  (2,3].  It  addresses  the  problem 
of  how  to  choose  the  best  bid  when  faced  with  uncertainty  about  your  own 
production  costs  and  your  competitors'  lowest  bid.  In  this  problem  the 
profit  from  a  contract  secured  by  competitive  bidding  depends  on  two  inde¬ 
pendent,  continuous  random  variables:  production  cost  and  lowest  competi¬ 
tive  bid.  The  conclusions  derived  from  the  following  calculations  apply 
whether  or  not  the  random  variables  are  independent,  but  the  results  are 
less  intuitive  and  more  striking  in  the  case  where  they  are  independent. 

It  is  easy  to  show  that  the  procedures  developed  in  this  example  can  be 
applied  to  discrete,  as  well  as  continuous,  random  variables.  It  can  also 
be  shown  that  the  procedures  and  results  apply  when  there  are  more  than 
two  random  variables,  but,  in  that  case,  the  calculations  become  quite 
long  and  difficult.  The  bidding  example  do.'s  not  consider  utility  func¬ 
tions  or  risk  preference  but  the  extension  of  the  following  calculations 
to  include  these  concepts  is  straightforward.  The  prices  of  the  observ¬ 
ables  are  assumed  to  be  additive  and  certain. 

Notation 

Although  the  bidding  problem  has  been  stated  and  solved  by  Howard, 
it  will  be  restated  briefly  here  so  that  this  work  is  self-contained. 
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Restating  the  problem  also  makes  it  possible  to  adopt  a  notation  slightly 
different  from  the  one  which  Howard  uses.  Although  Howard's  inferential 
notation  is  very  useful  and  has  broad  applications,  the  following  nota¬ 
tion,  based  on  operators,  is  somewhat  clearer  and  more  compact  when  deal¬ 
ing  with  the  value  of  information. 

The  inferential  notation  used  by  Howard  shows  explicitly  the  state 
of  information  of  the  person  making  the  bidding  decision.  In  this  paper 
the  decision  maker's  prior  state  of  information  will  not  be  shown  explic¬ 
itly,  and  the  state  of  his  information  at  any  time  during  the  decision 
process  will  be  shown  by  the  use  of  certain  operators.  The  notation  uses 
the  following  definitions: 

A  “a  state  of  information  on  which  probability  assignments  are  made. 


&  ■  the  decision  maker's  prior  state  of  information, 

{xU}  *  the  density  function  (for  continuous  random  variables)  or  mass 

function  (for  discrete  random  variables)  of  the  random  variable  x  , 
given  the  state  of  information  A  , 

<x|4>  *  /x^xl^j-  dx  ■  the  expected  value  of  x  given  the  state  of  informa¬ 
tion  A  , 

x  *  <x|&>  *  the  expected  value  of  x  given  the  decision  maker's  prior 
state  of  information  , 

Ti(x^ . xn,  c)  ■  a  prjfit  function  that  depends  on  the  state  and 

control  variables, 


c  =  a  control  or  decision  variable  (possibly  vector-valued)  upon  which  the 
profit  depends  , 
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xi  ~  a  state  variable;  a  random  variable  upon  which  the  profit  depends. 

(If  we  a.'e  dealing  with  perfect  information,  x^  is  also  an  observ¬ 
able  . ) 


yj  -  an  observable;  a  random  variable  whose  actual  value  we  have  an 
opportunity  to  learn  , 

x.  ^xl’  •••»  xn  >  c)  “  •••»  xn »  c)  dx  =  the  expected  value 

of  the  profit  with  respect  to  x^^  , 


max  tt(x^,  x^,  c)  =  the  maximum  of  the  profit  with  respect  to  c  , 


=  cost  of  learning  x^  , 

=  the  value  of  learning  xt  given  that  no  addition;.  1  information  is 
purchased;  the  value  of  individual  information  about  x^  (the 
superscript  N  means  "no  additional  information")  , 


N 

x^Xj...x  =  va^ue  learning  x^  >  xj  »  an^  xr  simultaneously 

given  that  no  additional  information  is  purchased;  the  value  of 
simultaneous  information  about  x^  ’  xj  >  •  •  •  >  and  x  , 


Xi.  .Xn"  \  '  •••  "  ’  \+1  -  •••  -  Kxu  >  the  residual 

value  of  learning  x£  when  all  of  the  available  information  is 
purchased  simultaneously;  the  residual  value  of  x±  ,  (the  super¬ 
script  R  stands  for  "residual  value?’)  , 


Vx^  *  t*ie  value  of  learning  x^  when  additional  information  can  be  pur¬ 
chased;  the  value  of  sequential  information  about  x±  . 
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The  costs  and  values  above  refer  to  perfect  information  since  the 
quantities  in  the  subscripts  are  state  variables.  If  the  subscripts  are 
observables,  the  costs  and  values  can  refer  to  imperfect  information.  In 
this  chapter  we  will  be  concerned  with  perfect  information. 

and  m^x  are  the  two  basic  operators  that  are  used  in  the  fol¬ 
lowing  discussion.  By  themselves,  these  operators  do  not  show  the  state 
of  information  of  the  decision  maker  at  the  time  that  the  expected  or 
maximum  value  is  determined.  However,  when  a  string  of  these  operators 
is  applied  to  Tf(x^,  ...,  x^,  c)  such  that  there  is  one  expectation  opera¬ 
tor  for  each  random  variable  and  one  maximization  operator  for  the  control 
variable,  the  string  of  operators  contains  all  of  the  information  neces¬ 
sary  to  show  the  decision  maker's  state  oZ  information. 

For  example,  the  following  expression  represents  the  expected  profit 
if  the  decision  maker  chooses  the  best  setting  of  the  control  variable 
without  any  information  about  the  state  variables  other  than  his  prior 
state  of  information 


Tl  1,  •  •  1  "<*1 . V  c> 

i  l  n 


In  inferential  notation  this  would  be  written 

max(«. .  .<rr(x1,  ...,xn,  c)|x1>  ....  xnl>  c,  e>| . .  .>|  c ,  fe>) 

As  the  inferential  notation  shows,  each  expectation  is  conditioned  on  a 
number  of  state  and  control  variables.  In  the  operator  notation  this 
means  that  jj  is  interpreted  as  the  expected  value  with  respect  to  x^ 
given  all  of  the  control  or  random  variables  that  appear  cs  subscripts  of 
other  operators  that  operate  on  ^  .  We  could  show  this  dependency  in 
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the  operator  subscripts  by  writing 


max  ^  ^  n(Xl . xn,  c)  -  max  E^  ...  E  | 


Xnlc»x1»- • • ,xn_1 


TT 


However,  this  is  unnecessarily  cumbersome. 

When  we  are  dealing  with  perfect  information  and  independent  state 
variables,  there  is  no  need  to  worry  about  dependencies  among  the  state 
and  control  variables.  However,  in  many  problems  the  state  variables  are 
dependent.  Furthermore,  we  must  consider  dependent  random  variables  when 
we  look  at  imperfect  information.  We  can  still  use  the  operator  notation 
as  long  as  we  are  careful  to  interpret  it  correctly. 

At  times  we  will  want  to  write  expressions  in  operator  notation  that 
do  not  include  all  of  the  control  or  random  variables  as  subscripts  of  an 
operator.  When  we  are  dealing  with  dependent  random  variables,  we  need  to 
know  whether  or  not  the  expectations  in  an  expression  are  conditioned  on 
the  random  variables  that  are  not  present.  For  example,  max  E  rtCx,  ,x0,c) 

C  X2  1  4. 

could  mean 


max 

c 


00 

(/  tt(jc1>X2’c^  {x2Ixi»c’5}  dx2) 


or 


max(  /  tt(x1,x2,c)  |x?|c,fe}dx2j 


The  question  is  whether  to  use  the  conditional  or  marginal  density  function 
when  determining  the  expected  value  of  TT  with  respect  to  X2  •  In  keep¬ 
ing  with  the  rule  that  E  is  interpreted  as  the  expected  value  with  re- 

xi 

spect  to  x^  given  all  of  the  control  cr  random  variables  that  appear  as 

subscripts  of  other  operators  that  operate  on  E  ,  we  define 

x2 


23 


max  |  tt(x1,x2,c)  -  max 


(  /  tt(Xi,x2 


»c)  {x2lc»t j  dx2 


The  expectation  is  not  conditioned  on  x^  because  x^  does  not  appear 

as  the  subscript  of  another  operator  that  operates  on  Ex 

Suppose  we  had  wanted  the  expectation  in  the  preceding  expression  to 

be  with  respect  to  X2  conditioned  on  x^  .  We  have  no  way  to  express 

this  in  operator  notation  using  only  the  maximization  and  expectation 

operators.  Therefore  we  define  a  pseudo-operator,  D  ,  that  does  not  do 

xi 

anything  to  its  argument,  but  indicates  that  all  subsequent  expectations 
are  conditioned  on  x^  .  Thus 

-GO 

\  “*x  x2  n(xl ’x2’c>  “  m£x(  i  TT(xltx2,c)  {x2(x  jC.s}  dx2) 

We  will  not  need  the  dependency  pseudo-operator  ^  in  this  chapter  be¬ 
cause  we  are  dealing  with  perfect  information  and  the  state  variables  are 
independent.  However,  we  will  need  this  notation  in  the  following 
chapters. 

Now  we  can  use  the  operator  notation  to  determine  the  value  of  in¬ 
formation.  Assume  that  the  decision  maker  fortuitously  learns  the  true 
value  of  xt  ,  and  does  not  intend  to  buy  additional  information.  Then 
his  expected  profit  is 


D  max  E 
x.  c  x. 


.  E  E 
Xi- 1  Xi+1 


•  •  •  §  TT(X-  , .  • .  ,x  ,c) 
x_  1  n 

n 


This  expression  is  a  function  of  xt  .  Before  the  decision  maker  learns 
the  actual  value  of  x^  ,  his  expected  profit  is 


*!-!  *l+l  "•  *„  n<Xl . Vc> 
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This  is  simply  the  expected  value  with  respect  to  xt  of  the  preceding 
expression.  If  the  decision  maker  is  trying  to  maximize  his  expected 
profit,  he  will  view  the  value  of  perfect  information  about  x1  as  the 
increase  in  his  expected  profit.  Thus  the  value  of  perfect  information 
about  xt  ,  given  that  no  additional  information  will  be  received,  is 


,  N 


\  mftx  \ 


E  E 
i-I  Xi+1 


E  -  max  E 
Xn  c  X1 


& 

n 


Similarly,  if  the  decision  maker  knows  that  he  will  learn  xt  and 
Xj  —but  no  additional  information-before  he  has  to  choose  a  value  for 
c  ,  his  expected  profit  prior  to  receiving  the  information  is 


E  E  max  E 
i  Xj  c  X1 


E  E 
Xi-1  Xi+1 


E  E  . . .  E  rr 
Xj-1  Xj+1  Xn 


In  this  case  the  value  of  perfect  information  about  these  two  state 
variables  is 


V* 


XiXj 


(E 

x 


i  j 


max  E 
c  x. 


E 

i-1  Xi+1 


E 

x 

n 


"«?,  ...  E  )  KKj 
1  n 


,Vc> 


The  Bidding  Problem 

The  operator  notation  will  now  be  used  to  solve  the  bidding  problem. 
Suppose  our  company  must  make  a  single  sealed  bid  for  a  contract  to  pro¬ 
duce  a  specific  quantity  of  some  commodity.  The  company's  objective  in 
bidding  is  to  maximize  its  expected  profit.  We  know  exactly  what  must 
be  done  to  meet  the  terms  of  the  contract  but  we  are  uncertain  about  how 
much  it  will  cost.  Let  p  be  our  production  cost  and  let  {p|&}  repre¬ 
sent  our  probability  density  function  on  p  based  on  our  prior  state  of 
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information.  The  techniques  for  assessing  {pU/  are  discussed  in 
several  papers  [1,4,11].  We  shall  assume  that  the  decision  maker’s  prior 
state  of  information  about  p  has  already  been  determined,  and  that  the 
resulting  probability  density  function  is  a  uniform  distribution  between 


zero  and  one . 


Similarly,  let  l  be  our  competitors’  lowest  bid  and  let 
be  the  probability  density  function  on  l  based  on  our  prior  state  of 
information.  Assume  that  {l|&}  is  a  uniform  distribution  between  zero 
and  two,  and  that  the  decision  maker  has  assessed  p  and  l  as  inde¬ 
pendent  random  variables.  The  prior  probability  density  functions  for 
p  and  i  are  shown  in  Fig.  2.1.  Although  we  do  not  write  these  dis¬ 
tributions  explicitly  in  our  notation,  they  will  be  used  in  the  calcula¬ 


tions  \ henever  we  need  to  determine  the  expected  value  of  some  function. 

The  profit  in  this  bidding  situation  obviously  depends  on  L  and 
p  .  It  also  depends  on  the  amount  we  bid,  b  .  In  this  problem  l 
and  p  are  the  state  variables  and  b  is  the  control  variable  (decision 
variable).  If  our  bid  is  higher  than  the  lowest  competing  bid,  then  we 


will  not  get  the  contract  or  incur  any  production  costs,  so  our  profit 
will  be  zero.  If  our  bid  is  less  than  the  lowest  competing  bid  we  will 
win  the  contract  and  receive  an  amount  of  money  equal  to  b  .  However, 
we  will  pay  a  production  cost  to  meet  the  terms  of  the  contract,  so  our 
profit  will  be  the  difference  between  b  and  p  .  Thus  the  profit  is 
given  by 


TT(p,X,b)  - 


b-p  :  b  <  Jfc 


0  :  b  >  l 


't 
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It  is  possible  to  view  the  profit  tt  as  a  random  variable  since  it  is  a 
function  of  the  random  variables  p  and  l  .  It  is  also  possible  to 
consider  the  value  of  information  as  a  random  variable.  We  can  derive 
probability  density  functions  for  the  profit  and  the  value  of  informa¬ 
tion,  as  shown  in  Appendix  A.  However,  that  will  not  be  necessary  for 
this  example. 

If  we  do  not  receive  any  information  about  p  or  i  ,  then  the  ex¬ 
pected  profit  is 


mgx  E 


TT(p,A,b) 


l  5 


b-p  :  b  <  l 
0  :  b  >  l 


27/96 


The  maximum  profit  occurs  when  we  make  a  bid  of  5/4  . 


The  Values  of  Individual  and  Simultaneous  Information 

If  we  are  given  perfect  information  about  our  production  cost,  and 
do  not  intend  to  buy  information  about  the  lowest  competing  bid,  then  our 
expected  profit  prior  to  learning  this  information  is 


E 

P 


mgx  ^  TT(p,i,b) 


b-p  :  b  <  l 
0  :  b  >  l 


28/96 


The  maximum  profit  occurs  when  we  make  a  bid  equal  to  (1+  p/2)  .  Using 
the  result  above  for  the  expected  profit  we  find  that  the  value  of  perfect 
individual  information  about  p  is 


'p  ■  <f  T  \ '  T  p  ¥  TT(p ,  £,b)  -  28/96  -  27/96  -  1/96 


If  we  are  given  perfect  information  about  our  competitors'  lowest 
bid,  and  do  not  intend  to  buy  information  about  our  production  cost,  then 
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our  expected  profit  prior  to  learning  this  information  is 


E  max  E  n(p,2,b)  =  E  max  E 
l  bp  l  b  p 


b-p  :  b  <  l 


b  >  l 


54/96 


The  maximum  profit  occurs  when 


b 


■  i  :  l  >  1/2 

«  :  l  <  1/2  - 


In  other  words,  we  should  just  underbid  the  competition  whenever  we  learn 
that  their  bid  will  be  high  enough  to  allow  us  to  have  a  positive  ex¬ 
pected  profit.  Otherwise  we  should  not  bid.  The  value  of  perfect  indi¬ 
vidual  information  about  l  is 


mgx  E  -  mgx  E  |)  TT(p,£,b)  -  54/96  -  27/96  -  27/96 

If  we  are  given  perfect  information  about  both  p  and  j l  simulta¬ 
neously,  then  our  expected  profit  prior  to  learning  this  information  is 


E  ^  mgx  rr(p ,  X,b) 


b  <  l' 

b  >  l 


56/96 


The  maximum  expected  profit  occurs  when 


b 


l>  P  j 


l  <  p  J 


In  other  words,  we  should  just  underbid  the  competition  whenever  we  learn 

I 

that  their  bid  will  exceed  our  production  costs.  Otherwise  we  should  not 
bid.  The  value  of  perfect  simultaneous  information  about  both  p  and  l 
is 
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VN  -  (E  E  max  -  max  E  E)  TT(p,i,b)  -  56/96  -  27/96  -  29/96 
P*  p  l  b  b  p  | 

Now  we  can  compare  with  vjj  and  .  As  the  examples  in  the 

introduction  demonstrate,  the  value  of  simultaneous  information  about  p 
and  j l  need  not  equal  the  sum  of  the  values  of  information  about  p  and 
j l  individually.  The  calculations  above  show  that 

1/96  +  27/96  -  28/96  +  VN, 

Pi  Pi 

To  gain  a  better  understanding  of  this  situation  define  the  purchase 

prices  of  perfect  information  about  p  and  i  to  be  K  and  K.  ,  re- 

P  i 

spectively.  We  are  willing  to  buy  perfect  information  about  p  when 
Kp  <  vjj  ,  about  i  when  ,  and  about  both  p  and  i  when 

(Kp  +  K^)  <  +  .  (There  may  be  situations  where  the  cost  of  learning 

perfect  information  about  two  random  variables  does  not  equal  the  sum  of 
the  prices  of  learning  the  two  individually.  The  case  of  non-additive 
prices  will  be  discussed  in  Chapter  5.)  These  decision  rules  are  shown 
graphically  in  Fig.  2.2.  Any  pair  of  prices  is  represented  by  a  point  on 
the  Kp-K^  diagram,  which  we  call  the  "price  diagram."  We  will  buy  per¬ 
fect  information  about  p  fer  any  pair  of  prices  represented  by  a  point 
below  the  line  A-B.  We  will  buy  perfect  information  about  l  for  any 
pair  of  prices  represented  by  a  point  to  the  left  of  the  line  C-D.  We 
will  buy  simultaneous  information  about  p  and  l  for  any  pair  of  prices 
represented  by  a  point  below  and  to  the  left  of  the  line  E-F. 

The  interesting  thing  about  Fig.  2.2  is  that  there  are  pairs  of 
prices,  represented  by  points  in  the  interior  of  the  triangle  G-H-I, 
such  that  we  would  be  unwilling  to  pay  for  perfect  information  about 
either  p  or  l  separately,  but  we  would  be  willing  to  pay  the  same 
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prices  to  learn  the  two  simultaneously.  This  sort  of  diagram  is  useful 
in  the  following  discussion  where  it  will  be  shown  that  there  are  other 
pairs  of  prices,  represented  by  points  above  and  to  the  right  of  the 
boundary  D-H-I-B,  such  that  we  will  be  willing  to  pay  for  perfect  lnforma- 

tion  about  one  or  more  of  the  random  variables. 

Although  Fig.  2.2  shows  that  we  would  be  willing  to  buy  indivudal  or 

simultaneous  information  about  p  or  i  for  any  pair  of  prices  repre 
seated  by  a  point  below  and  to  the  left  of  the  boundary  D-H-I-B,  it  does 
not  tell  us  which  information  purchase  is  most  advantageous.  Assume  for 
the  moment  that  we  can  only  buy  pieces  of  information  individually  or 
simultaneously.  We  can  determine  which  kind  of  information  purchase  is 
best  by  comparing  the  increase  in  expected  profit  in  each  case,  since  our 
objective  is  to  maximise  expected  profit.  The  inc  '.se  in  expected  profit 
is  the  difference  between  the  value  of  the  information  and  the  cost  of  the 
information.  Therefore  we  should  pay  for  simultaneous  information  about 
p  and  Jt  when  the  following  three  conditions  are  met: 


Simplifying  these  inequalities  yields 

K  </.-/«  29/96  -  1/96  -  28/96 
i  pi  P 

K  <  V*  -  VN  -  29/96  -  27/96  -  2/96 
p  pi  l 

K  +  K.  <  vJJ,  -  29/96 
P  i  Pi 


Similar  inequalities  can  be  written  when  our  best  decision  is  to  buy 
individual  information  about  p  or  jt  .  These  inequalities  define  the 
decision  regions  shown  in  Fig.  2.3. 

Using  Fig.  2.3  we  can  immediately  determine  our  best  response  when 
we  are  offered  perfect  individual  or  simultaneous  information  about  p 
and  l  at  prices  Kp  and  respectively.  As  Fig.  2.3  shows,  it  is 

necessary  to  know  the  prices  of  both  pieces  of  information  to  decide 
which  observable  to  buy,  even  when  only  individual  and  simultaneous  pur¬ 
chases  are  possible.  We  shall  see  that  it  is  possible  to  draw  a  similar 
diagram  when  we  have  the  option  to  buy  information  sequentially.  When 
sequential  information  is  available  the  decision  regions  become  more  com¬ 
plicated  than  those  in  Fig.  2.3,  and  the  best  information  purchase  at 
any  pair  of  prices  can  be  different  from  what  it  is  in  Fig.  2.3. 

We  can  use  ,  the  value  of  simultaneous  information  about  p 

and  l  ,  to  define  two  related  quantities:  V^(K,'  and  vV)  . 

V^(K^)  is  the  residual  value  of  learning  p  when  we  must  buy  informa¬ 
tion  about  p  and  l  simultaneously,  and  the  information  about  l 
costs  .  We  call  V^vK^)  the  residual  value  of  p  .  The  maximum 

amount  we  will  pay  for  this  information  is  (V**,  -  K.)  ,  and,  by  defini- 

P  M  l 

tion,  the  maximum  amount  that  we  will  pay  for  information  is  the  value 
of  that  information.  Therefore  we  define 

The  superscript  R  stands  for  "residual  value." 

We  are  willing  to  buy  information  about  p  and  j l  simultaneously 
whenever 


K  <  V  (K.) 
p  ~  p  i 
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Decision  regions  for  individual  and  simultaneous  information 


This  is  just  another  way  to  write  the  decision  rule  for  buying  SImulU- 
neous  information  about  P  and  l  .  Substituting  i„  this  Inequality 
brings  us  bacK  to  the  decision  rule  we  found  previously 

K  +  K.  <  V*1 
P  ^  “  p£ 

In  exactly  the  same  way  we  define 

-  C  -  KP 

We  should  buy  information  about  p  and  1  simultaneously  whenever 


Ki ; 


For  the  bidding  example, 


V^(K£)  =  29/96  -  K£ 

^(K  )  *  29/96  -  K 
*  P  p 

we  write  v£(K£)  or  V£(Kp)  we  are  assigning  all  of  the  value 
of  learning  p  and  l  simultaneously  to  one  of  the  observables.  While 

this  may  seem  artificial,  it  is  useful  t-u* 

,  re  is  usetui  in  the  discussion  that  follows. 

We  shall  see  that  the  value  of  sequential  information  about  p  approaches 

p  when  K£  is  very  large,  and  it  approaches  V^(K£)  when  K  is 

small.  Similarly,  V£(Kp)  approaches  vj  when  Kp  is  very  large  and 

VKp)  when  Kp  is  small. 

We  now  want  to  consider  the  process  of  buying  perfect  information 
sequentially.  We  shall  see  that  gaining  perfect  infection  about  one 
state  variable  can  tell  us  something  about  whether  or  not  to  pay  for 


perfect  information  about  a  second  state  variable,  even  though  we  have 
assumed  that  they  are  independent  random  variables. 

The  Value  of  Sequential  Information  about  p 

We  shall  now  determine  the  value  of  perfect  information  about  p 
when  we  know  that  subsequently  we  can  pay  K£  for  perfect  information 
about  l  .  Assume  for  a  moment  that  we  already  know  the  actual  value 
of  our  protection  cost,  and  that  we  are  trying  to  decide  whether  or  not 
to  buy  perfect  information  about  our  competitors'  lowest  bid.  Since  p 
and  l  are  independent  random  variables,  our  probability  density  func¬ 
tion  for  i  is  unchanged  by  our  knowledge  of  p  .  How  much  is  the  addi¬ 
tional  information  about  j l  worth  to  us? 

If  we  decide  not  to  learn  l  ,  then  the  expected  profit  as  a  func¬ 
tion  of  p  (which  we  already  know)  is 

5  TT(p,f,b)  -  (1  -  p/2>2/2 

If  p  and  l  were  dependent  random  variables  we  would  have  to  write 

J  ”gx  \  TT(p,i,b) 

since  the  expectation  is  conditioned  on  the  value  of  p  that  we  learned 

previously.  However,  we  can  drop  the  D  pseudo- operator  since  p  and  > 

l  are  independent.  The  maximum  expected  profit  occurs  for  a  bid  of 

b  -  1  +  p/2 

This  expected  profit  is  shown  in  Fig.  2.4a. 

On  the  other  hand,  if  we  decide  to  learn  l  ,  then  the  expected 
profit  as  a  function  of  p  is 
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gx  ^  TT(p,  Jt,b) 


E  max  TT(p,Jt,b) 
j l  b 


(1  -  p/2)2 


The  maximum  expected  profit  occurs  for  a  bid  of 

\ 


b  - 


X  :  X  >  p 


|  oo  :  i  <  p 


This  Is  shown  In  Fig.  2.4b.  The  Increase  In  the  expected  profit  caused 
by  learning  X  when  we  already  know  p  Is  the  difference  between  these 
two  expressions: 

(E  max  -  max  E)  TT(p,X,b)  -  (1  -  p/2)2/2 
X  b  b  X 

Now  suppose  that  the  price  of  perfect  Information  about  X  Is  . 
Obviously  we  should  pay  this  price  when  the  Increase  In  the  expected 
profit  exceeds  ;  otherwise  we  should  not  buy  the  information.  Thus 
we  should  pay  for  perfect  information  about  X  when 


KX< 


(lj  m£x  -  mgx  n(p,X,b) 


This  decision  rule  is  shown  graphically  for  the  bidding  problem  in  Fig. 
2.4c.  It  is  obvious  from  this  inequality,  or  from  Fig.  2.4c,  that  for 
certain  values  of  the  decision  to  buy  or  not  buy  perfect  Informa¬ 

tion  about  X  depends  on  the  value  of  p  that  we  learned  earlier. 
Actually  there  are  three  cases: 

(1)  If  <  1/8  ,  we  will  always  pay  to  learn  X  ,  regard¬ 

less  of  the  value  of  p  ,  because  the  increase  in  the  expected 
profit  will  always  exceed  .  In  this  case  our  expected 
profit  as  a  function  of  p  is 
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E  max  rr(p,  £,b)  -  K£  =  (1  -  p/2)2  -  KjJ 

(2)  If  1/8  <  <  1/2  ,  we  may  or  may  not  pay  to  learn  Z 

depending  on  the  value  of  p  .  We  will  pay  to  learn  Z 
when 


<  (i  -  p/2)  /?  or  0  <  p  <  2(1  -  sf2K~.) 


Otherwise  we  will  not  pay  to  learn  Z  .  Thus  the  expected 
profit  as  a  function  of  p  is 


[  E  max  TT(p,£,b)  -  K  1 


max 


max  E  TT(p ,  £,b) 
b  £ 


E  max  n(p,£,b)  -  K  :  0  <  p  <  2(1  -  JET)  ' 
m)  l  ~  i 

."{J*  \  TT(P,i,b)  :  2(1  -  JET)  <  p  <  1  . 

Sj  ™ 

(1  -  p/2)2  -  :  0  <  p  <  2(1  -  v/2K~) 

=  - 

(1  -  p/2)  2/2  :  2(1  -  v/2icp  <  p  <  1  . 

O)  If  K£  >  1/2  ,  we  will  never  pay  K£  to  learn  Z  ,  regardless 
6f  theivalu*  of  pb,.beeausft  iwill  always  exceed  the  increase 
in  the  expected  profit.  In  this  case  our  expectad  profit  as  a 
function  of  p  is 


E  tt(p , £,b)  =  (1  -  p/2)2/2 

These  expressions  give  us  the  expected  profit  when  we  already  know 
We  can  determine  our  expected  profit  before  we  learn  p  by  taking 
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the  expected  value  with  respect  to  p  of  the  previous  results.  Thus  our 
expected  profit  when  we  know  that  we  will  receive  perfect  information 
about  p  ,  but  before  we  actually  receive  the  information,  is 


r  E  (1  -  p/2)2-  K£  :  K^<  1/8 


2(l-/2Kp 


JJ 1  [(1-P/2)2-  Kt]  {pji}  dp  • 


t, _  f (l-p/2) 2/2]  {pi*}  dp 


2(l-x/2K ") 


1/8  <  K£  <  1/2 


|E  (1  -  p/2)  /2  :  1/2  <  K 


T 56/96  -  <  1/8 


-  60/96  +  (4/3)Kx  >/2K^  -  2K£  :  1/8  <  Kj  <  1/2 1 


l 


28/96  :  1/2  <  K£ 


Since  our  expected  profit  without  any  information  is  mgx  E  E  n(p,X,b) 


we  must  subtract  this  quantity  from  the  result  above  to  get  the  value  of 


perfect  sequential  information  about  p  ,  or  V  (K.)  . 

P  * 


r'E  mgx  tt(p>  X,b)  - 


w  •  f 


max« 


E  TT(p ,  jfc,b) 


mgx  E  E  TT(p,i,b) 


r 


29/96  -  Kj  :  <  1/8 


^  33/96  +  (4/3)Kjt>/5K][  -  2K£  :  1/8  <  Kj  <  1/2 1 
1/96  :  1/2  <  K . 


1 


i 


Thus  if  we  are  offered  perfect  information  about  p  for  a  price  K 


P  ’ 

we  will  accept  the  offer  when  K  <  V  (K.)  .  However,  V  depends  on  K. 

p~px  p  * 

the  cost  of  perfect  information  about  £  .  Therefore  we  must  know  both  K 

P 

and  before  we  can  decide  whether  or  not  to  accept  the  offer 

In  terms  of  K  and  K.  ,  we  should  pay  to  learn  p  whenever 
P  * 


r 


29/96  -  <  1/8 


K  <  <  33/96  +  (4/3)K.\/2K“  -  2K  :  1/8  <  K.  <  1/2 


l 


1/96  :  1/2  <  ViJL 


This  decision  rule  is  shown  graphically  in  Fig.  2.5.  We  are  willing  to 
pay  Kp  to  learn  p  for  any  pair  of  prices  represented  by  a  point  below 
the  boundary  A-B-C-D.  Before  discussing  the  significance  of  this  diagram, 
we  will  carry  out  another  calculation,  similar  to  the  one  above,  to  deter¬ 
mine  the  value  of  perfect  sequential  information  about  £  . 


The  Value  of  Sequential  Information  about  £ 

This  time  we  will  determine  the  value  of  perfect  information  about 
£  when  we  know  that  we  can  subsequently  pay  for  perfect  information 

about  p  .  Assume  for  a  moment  that  we  know  the  actual  value  of  our  com¬ 
petitors'  lowest  bid,  and  that  we  are  trying  to  decide  whether  or  not  to 
buy  perfect  information  about  our  production  cost.  How  much  is  the  addi¬ 
tional  information  about  p  worth  to  us? 

If  we  decide  not  to  learn  p  ,  then  the  expected  profit  as  a  function 
of  £  is 

r 

0  :  0  <  £  <  1/2 


max  E  TT(p,£,b) 
b  p 


£  -  1/2  r  1/2  <  £  <  2 
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The  maximum  expected  profit  occurs  for  a  bid  of 


This  expected  profit  is  shown  in  Fig.  2.6a.  On  the  other  hand,  if  we 
are  given  perfect  information  about  p  ,  then  the  expected  profit  as  a 
function  of  l  is 


This  is  shown  in  Fig.  2.6b.  The  increase  in  expected  profit  caused  by 
learning  p  when  we  already  know  i  is  the  difference  between  these 
two  expressions: 

{l2/ 2  :  0  <  l  <  1/2 

(1  -  J)2/2  :  1/2  <  l  <  1 
0  :  1  <  l  <  2 


How  suppose  that  the  price  of  perfect  information  about  p  is  Kp  . 
Vie  should  pay  this  price  when  the  increase  in  the  expected  profit  ex¬ 
ceeds  Kp  ;  otherwise  we  should  not  buy  the  information.  Thus  we  should 
pay  for  perfect  information  about  p  when 

Kp  <  (E  mgx  -  mgx  E)  TT(p,jt,b) 
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This  decision  rule  is  shown  graphically  in  Fig.  2.6c.  It  can  be  seen 
from  this  inequality,  or  from  Fig.  2.6c,  that  for  certain  values  of  K 

P 

the  decision  to  buy  or  not  buy  perfect  information  about  p  depends  on 

the  value  of  l  that  we  learned  earlier.  This  time  there  are  only  two 
cases: 

(1)  If  Kp  <  1/8  ,  we  may  or  may  not  pay  Kp  to  learn  p 

depending  on  the  value  of  l  .  We  will  pay  to  learn  p  when 

Kp  <  l2/ 2  ,  and  Kp  <  (1  -  X)2/2 


These  inequalities  can  be  rewritten  as  follows: 


VaT  <  l  <  1  -  y/W 

P  p 


Otherwise  we  will  not  pay  to  learn  p  .  Thus  the  expected 
profit,  as  a  function  of  l  ,  is 


max., 


E  mgx  TT(p,X,b)  -  K, 
mgx  E  TT(p,Jt,b) 


e  mgx  TT(P,j,b) .  Kp  :  >nr  <  l  <  i  _  n/2T 

max  g  TT(p,i,b)  :  0  <  l  <  y/7T  ,  1  -  y^TlT  <  l  <  2 

0  :  0  <  i  <  >/2K" 

-  -  p 

lZ/2  -  K  :  s/2 T  <  X  <  1  -  \[W 
P  P  p 

X  -  1/2:1-  V2Kp  <  l  <  2 


(2)  If  Kp  >  1/8  ,  we  will  never  pay  Kp  to  learn  p  ,  regardless 
of  the  value  of  p  ,  because  Kp  will  always  exceed  the  in¬ 
crease  in  the  expected  profit.  In  this 


case  our  expected 


profit,  as  a  function  of  l  ,  is  : 

0  :  0  <  i  <  1/2 


max  E  TT(p,i,b)  ■ 


L  -  1/2  :  1/2  <  L  <  2 


These  expressions  give  us  the  expected  profit  when  we  already  know 
l  .  We  can  determine  our  expected  pront  before  we  learn  l  by  taking 
the  expected  value  with  respect  to  l  of  the  previous  results.  Thus 
our  expected  profit  when  we  know  that  we  will  receive  perfect  informa¬ 
tion  about  l  ,  but  before  we  actually  get  the  information,  is 


{E  max  TT(p ,  Jt,b)  -  K 
P  b  P 

max  E  TT(p ,  A,b) 


) 


U2/2  -  K  ){jt|sW  +  f  Ur  l/2){jt|&}djl  :  K  <  1/8 

Lr  P  L 


v^r 


/  u  -  1/2)  {jl!*}df  :  K  >  1/8 


1/2 


56/96  +  (2/3)Kp/2Kj  -  Kp/2  :  Kp  <  1/8 


54/96  :  K  >1/8 
P  “ 


Since  the  expected  profit  without  any  information  is  mgx  E  ^  TT(p,i,b) 

we  must  subtract  this  quantity  from  the  result  above  to  get  the  value 

of  perfect  sequential  information  about  l  ,  or  V.(K  )  . 

I  p 


VV  '  I  “  ) 


E  max  rr(p, A,b)  -  K 
P  D  P 

mgx  |  TT(p,|,b) 


1- 


max  E  E  tt(p  ,  jt,b) 


■( 


29/96  +  (2^KpV7R“  -  Kp/2  :  Kp  <  1/8 

27/96  :  K  >  1/8 
P  “ 
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If  we  are  offered  perfect  information  about  L  for  a  price 
should  accept  the  offer  when  K.  <  V.(K  )  . 

L  J6  p 

In  terms  of  K  and  K.  ,  we  should  pay  K.  to  learn 
P  L  l 


29/96  +  (2/3)K^lT  -  K  /2  :  K  <1/8 
P  P  P  P 


27/96  :  K  >1/8 
P  ~ 


Kt  ,  we 

A  whenever 


This  decision  rule  is  shown  graphically  in  Fig.  2.7.  We  are  willing  to 
pay  to  learn  A  for  any  pair  of  prices  represented  by  a  point  to 

left  of  the  boundary  E-F-G. 

Combining  the  diagrams  in  Figs.  2.2,  2.5,  and  2.7  shows  how  these 
prices  are  interrelated.  The  combined  diagram  is  shown  in  Fig.  2.8. 
From  our  previous  results  we  know  that  we  syould  pay  to  learn  the 

actual  value  of  p  for  any  pair  of  prices  represented  by  a  point  below 
the  curve  A-B-C-D.  In  addition  we  should  pay  to  learn  the  actual 

value  of  A  for  any  pair  of  points  to  the  left  of  the  curve  E-F-G. 
Therefore  we  should  be  willing  to  pay  for  perfect  information  about  one 
of  the  state  variables  when  offered  any  pair  of  prices  represented  by  a 
point  below  or  to  the  left  of  the  boundary  G-F-H-C-D.  This  set  of 
prices,  which  we  call  the  set  of  feasible  prices,  includes  all  of  the 
pairs  of  prices  that  we  found  previously  by  considering  the  purchase  of 
individual  information  about  each  of  the  state  variables.  It  also  in¬ 
cludes  all  of  the  pairs  of  prices  that  we  found  by  considering  the 
simultaneous  purchase  of  perfect  information  about  both  of  the  state 
variables . 
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The  Relative  Values  of  ,  V^(K.)  ,  and  V  (K.) 

______ _ _£ _ P  l  P  l 

Intuitively  we  would  expect  the  set  of  feasible  prices  for  sequen¬ 
tial  purchases  of  information  to  include  the  sets  of  feasible  prices  for 
individual  and  simultaneous  purchases  of  information  because  learning 
observables  individually  and  simultaneously  are  Just  special  cases  of 
learning  the  information  sequentially.  Purchasing  information  about  a 
single  state  variable  can  be  viewed  as  two  sequential  decisions:  first 
to  buy  Information  about  the  state  variable,  and  then  not  to  buy  any 
additional  information.  Similarly,  purchasing  information  about  both 
state  variables  can  also  be  viewed  as  two  sequential  decisions:  first 
to  buy  Information  about  one  state  variable,  and  then  to  buy  information 
about  the  other. 

It  is  easy  to  see  from  the  formulas  derived  previously  that  our 
intuition  is  correct.  Consider  the  value  of  perfect  irformation  about 
our  production  costs.  If  we  only  buy  perfect  information  about  p  , 
then  the  expected  value  of  the  information  is 

/  ■  E[max  E  Tf(p,jl,b)]  -  max  E  E  rr(p,jfc,b) 

If  we  buy  perfect  information  about  p  and  i  simultaneously,  then  the 
residual  value  of  learning  p  is 

/(Kj)  -  E[E  mgx  TT(p,jl,b)  -  KA]  -  max  E  E  TT<p,i,b) 

If  we  buy  perfect  information  about  p  and  l  sequentially,  then  the 
value  of  the  information  is 
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V  (K  )  =  E  max 
p  l  p 


\  mgx  TT(p,£,b)  -  K£ 


E  TT(p,£,b) 

b  l 


-  max  E  E  TT(p,j&,b) 
b  p  l 


From  the  form  of  these  equations  it  can  be  sern  that  V  (K  )  must 

p  l 

be  at  least  as  large  as  V*1  and  (K  )  for  any  value  of  K  .  The 

P  P  *  l 

last  term  in  all  three  expressions  is  the  same,  and  the  first  term  is 
the  expected  value  with  respect  to  p  of  some  quantity.  Obviously,  for 
any  value  of  p 


mgx  n(p,£,b)  - 


‘‘I, 


n§x  5  ^p*4*1*)  J 


E  mgx  TT(p ,  £,b)  - 


max  E  TT(p, jfc.b) 
b  l 


\  mgx  TT(p ,  1,  b)  - 


>  max  E  TT(p ,  j£,b) 


Therefore , 


E  max 
P 


E  max 
P 


E  mgx  TT(p,X,b)  - 

mgx  ^  "(p.A.b) 

^  mgx  TT(p,  Jt,b)  -  K£ 


max  E  TT(p,ji,b) 
b  l 


>  g[J  mgX  TT(p,*,b)  -  K£ 


>  E[mgx  E  TT(p,  A,b)  3 


Subtracting  mgx  |  |  TT(p , jt,b)  from  both  sides  of  these  inequalities 


yields 


W  2  v£(K  ) 


V  (K.)  >  V5 


Thus  for  any  value  of  ,  we  are  willing  to  pay  at  least  as  much 
to  learn  p  ,  with  an  option  to  learn  l  afterwards,  as  we  would  to 
learn  p  only,  or  to  learn  p  and  l  simultaneously.  This  result  is 
illustrated  in  Fig.  2.8.  The  curve  A-B-C-D  for  Vp(Kp  is  an  upper 
bound  for  the  straight  line  through  C  and  D  corresponding  to  vjj  ,  and 
for  the  line  A-E  corresponding  to  V^(Kp  • 

In  exactly  the  same  way  it  can  be  shown  that 


vy  2  'fyy 

VV  2  ^ 


In  Fig.  2.8  this  means  that  the  curve  G-F-H-E  corresponding  to  V^(Kp) 
must  lie  to  the  right  of  the  straight  line  passing  through  G  and  F  cor¬ 
responding  to  ,  and  the  line  A-E  corresponding  to  'fyy  • 

We  have  shown  that  the  set  of  feasible  prices  for  sequential  in¬ 
formation  includes  the  sets  of  feasible  prices  for  individual  and 
simultaneous  purchases.  From  Fig.  2.8  it  is  obvious  that  the  set  of 
feasible  prices  for  sequential  purchases  of  information  can  include 
pairs  of  prices  that  would  not  be  considered  feasible  when  only  indi¬ 
vidual  or  simultaneous  purchases  are  considered.  The  conditions  neces¬ 
sary  for  such  pairs  of  prices  to  exist  will  be  discussed  in  Chapter  4, 
but  intuitively  we  can  see  that  they  will  exist  whenever  the  knowledge 
of  one  random  variable  could  affect  our  decision  to  pay  to  learn  the 
other  random  variable.  Whenever  learning  a  piece  of  information  could 
cause  us  to  change  our  decision,  the  information  becomes  more  valuable 
than  it  would  be  if  we  had  no  subsequent  decision  to  make.  Because  we 
have  a  subsequent  decision  when  we  buy  information  sequentially,  the 
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value  of  perfect  information  can  be  greater  in  that  case  than  when  the 
information  is  purchased  individually  or  sequentially. 


Decision  Regions  in  the  Price  Diagram 

Although  Fig.  2.8  shows  that  we  would  be  willing  to  buy  perfect 
information  for  any  pair  of  prices  represented  by  a  point  below  and 
to  the  left  of  the  curve  G-F-H-C-D,  it  does  not  tell  us  which  state 
variable  to  buy  first.  We  should  pay  for  the  piece  of  information  that 
will  cause  the  greatest  increase  in  our  expected  profit  in  order  to 
maximize  our  expected  profit.  Since  the  increase  in  expected  profit  is 
the  difference  between  the  value  and  the  cost  of  the  information,  we 
should  first  buy  sequential  information  afctut  p  when 


VV  •  KP >  VV  -  h 


E  max 
P 


E  mgx  TT(p,  l,b)  -  K£ 


max  E  n(p ,  £,b) 
b  i 


«  E  |  TT(p ,  i.,b)  -  K 


>  E  m-i.x 


E  max  TT(p ,  £,b) 


mgx  g  TT<p, X,b) 


'  "T  P  1  •  K£ 


29/96  -  K  -  K 
l  P 

33/96  +  (4/3)K./2K"  -  ?K  -  K 
*  *  a  p 

1/96  -  K 


K£  <  1/8 
1/8  <  K£  <  1/2 ' 
1/2  < 


29/96  +  (2/3)Kp/2Kp  -  Kp/2  -  K£  :  Kp  <  1/8 


27/96  -  K, 
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In  addition  we  will  only  pay  to  learn  p  when  V^(K^)  >  .  Similar 

inequalities  can  be  written  to  show  when  we  should  first  buy  sequential 
information  about  l  ,  or  first  buy  information  about  p  and  l  simul¬ 
taneously.  These  inequalities  yield  the  decision  regions  shown  in 
Fig.  2.9. 

Using  Fig.  2.9  we  can  immediately  determine  our  best  response  when 

we  are  offered  perfect  sequential  information  about  p  and  L  at  prices 

K  and  K.  ,  respectively.  Figure  2.9  contains  regions  in  which  we 
P  * 

would  only  want  to  pay  for  one  piece  of  information  without  deciding 
afterwards  whether  or  not  to  buy  additional  information.  However,  this 
is  just  a  special  case  of  learning  the  information  sequentially.  As 
far  as  the  initial  decision  is  concerned,  there  are  only  three  alterna¬ 
tives:  learn  the  actual  value  of  p  ,  learn  the  actual  value  of  l  , 
or  do  not  buy  any  informatic-  Another  way  to  express  the  information 
in  Fig.  2.9  is  to  define  three  mutually- exclusive  and  collectively- 
exhaustive  sets  of  price  pairs,  ,  q  ,  and  ft  ,  such  that  when 

(K  ,K .)  c  ft  our  best  initial  decision  is  to  pay  K  to  learn  p  . 

P  *  P  P 

When  (K  ,K.)  e  ft.  our  best  Initial  decision  is  to  pay  K.  to  learn 
p  Jt  *  * 

l  ,  and  when  (K  ,K  )  c  ftp  ,  our  best  initial  decision  is  to  refuse  all 

information.  ftA  ,  ft  ,  and  ft,  are  called  decision  sets  and  they  cor- 
u  p  l 

respond  to  the  decision  regions  in  Fig.  2.9. 

Figure  2.9  shows  that,  for  this  problem,  the  option  of  buying  per¬ 
fect  information  about  p  and  l  simultaneously  is  completely  dominated 
by  the  other  alternatives.  This  occurs  in  spite  of  the  fact  that  there 
are  pairs  of  prices  such  that  buying  both  pieces  of  information  simul¬ 
taneously  is  preferable  to  huying  either  piece  of  information  individually. 

54 


PAY 


Decision  regions  for  sequential  information 


If  we  compare  Fig.  2.3  and  Fig.  2.9,  we  can  see  that  the  same  pair 

of  prices  can  cause  us  to  make  a  different  initial  decision  when  only 

individual  or  simultaneous  information  is  available,  than  it  can  when 

sequential  information  is  available.  Figures  2. 3  and  2.9  are  shown 

superimposed  in  Fig.  2.10.  If  K  and  K.  are  represented  by  point  A 

P  * 

in  Fig.  2-10,  our  best  initial  decision  when  offered  individual  or 
simultaneous  information  is  to  pay  to  learn  l  .  On  the  other 

hand,  if  we  can  buy  information  sequentially  at  the  same  prices,  our 
best  initial  decision  is  to  pay  to  learn  p  .  Similar  comparisons 

can  be  made  for  other  pairs  of  prices. 

A  Sequential  Information  Decision  Tree 

It  has  taken  quite  a  bit  of  calculation  to  determine  the  decision 
regions  shown  in  Fig.  2.9,  even  though  our  example  is  simple  by  compari¬ 
son  with  many  real-world  decision  problems.  Fortunately  all  of  this 
calculation  is  unnecessary  if  we  simply  want  to  know  what  to  do  when 
faced  with  a  decision  problem  and  a  specific  pair  of  prices  for  perfect 
information  about  the  random  variables.  When  the  prices  of  perfect 
information  are  known,  we  can  carry  out  a  relatively  simple  calculation 
to  find  out  which  alternative  maximizes  the  expected  profit.  For  the 
bidding  problem  this  calculation  is  equivalent  to  so’ving  the  decision  'f 
tree  shown  in  Figs.  2.11a  and  2.11b. 

Although  the  decision  tree  in  Fig.  2.11  looks  complicated,  it  is  a 
straightforward  calculation  to  solve  the  tree  for  the  best  decision  and 

the  resulting  expected  profit  when  K  and  K.  are  known.  Thus  for  any 

P  *> 

pair  of  prices  represented  by  a  point  in  Fig.  2.9  vie  can  solve  fo-  the 
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Comparison  of  decision  regions  with  end  without  sequential  Information 


Figure  2.11b.  Sequential  Information  dec !■ ion  tree  (continued) 


optimal  decision  without  determining  all  of  the  decision  regions.  By 
solving  the  decision  tree  fjr  a  number  of  different  pairs  of  prices,  we 
can  determine  the  approximate  boundaries  of  the  decision  regions  in 
Fig.  2.9  without  carrying  out  the  previous  calculations.  For  sequential 
information  problems  with  many  observables,  this  is  often  the  only 
practical  way  to  determine  the  decision  regions.  However,  as  we  shall 
see,  the  decision  tree  can  be  used  to  characterize  the  decision  regions 
when  there  are  only  two  pieces  of  information  available. 

Characterizing  the  Decision  Regions 

If  we  consider  those  regions  in  Fig.  2.9  where  our  best  initial 
decision  is  to  buy  information  about  p  ,  we  can  see  that  we  would  be 
willing  to  pay  a  significantly  greater  amount  for  information  about  p 
when  we  subsequently  have  the  option  to  buy  perfect  information  about  l  . 

Furthermore,  when  we  restrict  our  attention  to  only  those  pairs  of  prices 
for  which  our  best  initial  decision  is  to  buy  information  about  p  ,  the 
amount  we  would  be  willing  to  pay  to  learn  p  reaches  a  maximum  at  the 
pair  of  prices  corresponding  to  the  point  H.  Although  there  are  other 
pairs  of  prices  for  which  we  would  be  willing  to  pay  nore  to  learn  p 

than  we  would  at  the  pair  of  prices  corresponding  to  the  point  H,  we  y 

could  increase  our  expected  profit  more  by  first  paying  to  learn  l  in¬ 
stead  of  p  when  we  are  offered  one  of  these  pairs  of  prices.  Thus  the 
maximum  price  that  we  would  pay  to  learn  p  first  is  the  component 

of  the  point  H.  Exactly  the  same  reasoning  shows  that  the  maximum  amount 
that  we  would  pay  to  learn  l  first  is  the  component  of  the  point  H. 

The  value  of  perfect  information  about  a  random  variable  is  often 
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used  to  set  an  upper  limit  on  the  amount  that  we  should  pay  to  receive 
imperfect  or  partial  information  about  the  random  variable.  However,  we 
have  seen  that  the  value  of  perfect  information  varies  according  to  the 
price  of  perfect  information  about  the  other  random  variables.  What, 
then,  should  we  use  for  an  upper  bound  on  the  value  of  imperfect  informa¬ 
tion?  The  answer  is  the  maximum  value  of  perfect  information,  since  it 
must  be  at  least  as  large  as  the  value  of  perfect  information  at  any 
given  pair  of  prices,  which  in  turn  thus  must  be  at  least  as  large  as 
the  value  of  imperfect  information  at  the  same  pair  of  prices.  It  will 
be  shown  in  the  next  chapter  that  the  value  of  imperfect  information 
also  depends  on  the  prices  of  the  observables,  and  that  the  value  of 
imperfect  information  taken  sequentially  can  exceed  the  value  of  the 
same  information  when  it  is  received  alone. 

In  order  to  determine  an  upper  bound  for  the  value  of  imperfect 
information,  we  would  like  to  have  a  procedure  for  finding  the  maximum 
value  of  perfect  information  (corresponding  to  the  coordinates  of  the 
point  H  in  Fig.  2.9)  without  going  through  all  of  the  calculations  re¬ 
quired  to  determine  the  decision  regions.  Using  the  diagram  in  Fig. 

2.9  we  can  demonstrate  an  iterative  procedure  for  determining  the  coordi¬ 
nates  of  the  point  H  to  any  degree  of  accuracy.  This  procedure  will 
work  for  any  sequential  information  problem  with  two  observables. 

Suppose  we  firs  determine  the  values  of  perfect  information  about 

p  and  l  ,  assuming  in  both  cases  that  only  one  piece  of  information 

will  be  purchased.  This  gives  us  and  ,  the  coordinates  of 

point  I  in  Fig.  2.12a.  Now  use  the  coordinates  of  point  I  as  the  prices, 

K  and  K  ,  in  the  decision  tree  branches  of  Fig.  2.11b  to  find  the 
P  l 

expected  profits  associated  with  branches 


and  B2  .  Subtracting  the 


expected  profit  with  no  information  (the  expected  profit  associated  with 
branch  Bq)  from  the  expected  profits  associated  with  branches  and 

B^)  yields  the  values  of  sequential  information  about  p  and  l  ,  when 
the  cost  of  the  information  is  given  by  and  .  The  cost  of 

°  J  p  i 

initially  learning  p  or  i  is  shown  in  the  tree  in  Fig.  2.11a,  and 
is  not  included  in  the  branches  in  Fig.  2.11b.  Thus  subtracting  the 
expected  profits  associated  with  the  branches  in  Fig.  2.11b  will  yield 
the  desired  values  of  information.  It  can  be  seen  graphically  in  Fig. 
2.12a  that  the  resulting  values  of  information  are  the  coordinates  of 
the  point  J. 

Now  repeat  the  procedure  by  using  the  coordinates  of  the  point  J 

as  the  prices,  K  and  K  ,  in  the  decision  tree  in  Fig.  2.11.  Solv- 
P 

ing  for  the  expected  profits  associated  with  branches  B^  and  B^  and 
then  subtracting  the  expected  profit  associated  with  branch  Bq  yields 
two  new  values  of  information.  Figure  2.12b  shows  that  these  new  values 
are  the  coordinates  of  the  point  K.  The  procedure  can  then  be  continued 
using  the  coordinates  of  the  point  K  in  the  decision  tree  to  get  another 
point  that  is  even  closer  to  the  point  H. 

Solving  the  decision  tree  in  Fig.  2.11  repeatedly  involves  a  con¬ 
siderable  amount  of  calculation,  so  it  is  doubtful  that  anyone  would  want 

to  carry  this  procedure  through  many  steps.  Fortunately  it  is  not  neces- 

N  N 

sary  to  do  so.  The  first  iteration  using  V  and  V.  in  the  decision 

P  L 

tree  is  all  that  is  needed  to  determine  an  upper  bound  for  the  valup  of 
perfect  or  imperfect  information.  It  will  be  shown  in  Chapter  4  that 
for  any  sequential  information  problem  with  two  observables  the  point  J 


must  always  lie  above  and  to  the  right  of  the  point  H  if  it  does  not 
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coincide  with  the  point  H.  Thus  the  coordinates  of  the  point  J  must  be 
at  least  as  large  as  the  coordinates  of  the  point  H,  which  in  turn  must 
be  at  least  as  large  as  the  values  of  perfect  and  imperfect  information. 
Therefore,  the  coordinates  of  the  point  J  are  an  upper  bound  for  the 
value  of  sequential  information  about  the  random  variables. 

If  there  are  more  than  two  observables,  the  iterative  procedure 
need  not  converge  to  a  point  whose  coordinates  are  the  maximum  amounts 
that  we  would  pay  initially  for  sequential  information  about  the  ob¬ 
servables.  In  fact,  such  a  point  need  not  exist.  Furthermore  the 
values  of  information  determined  from  the  appropriate  decision  tree, 
with  the  cost  of  the  ith  observable  set  equal  to  VN  ,  need  not  be  uDper 

yi 

bounds  for  the  maximum  value  of  sequential  information. 

However,  even  though  we  cannot  use  the  procedure  discussed  above  to 
find  the  desired  upper  bounds  when  there  are  more  than  two  observables, 
we  can  find  a  very  simple  upper  bound  for  the  maximum  values  of  any  num¬ 
ber  of  observables  by  solving  the  decision  tree  with  all  of  the  prices 
set  equal  to  zero.  This  corresponds  to  starting  with  a  pair  of  prices 
represented  by  a  point  at  the  origin  in  Fig.  2.12.  It  is  easy  to  see 
that  solving  any  sequential-information  decision  tree  with  all  of  the 
prices  set  equal  to  zero  will  result  in  the  value  of  any  observable  being 
equal  to  the  value  of  learning  all  of  the  observables  simultaneously.  No 
matter  which  observable  we  decide  to  learn  first,  we  will  subsequently 
decide  to  learn  all  of  the  other  observables  because  they  are  free.  Thus 
the  value  of  learning  all  of  the  observables  simultaneously  is  an  upper 
bound  for  the  value  of  learning  any  of  the  observables  sequentially. 

For  the  biding  problem  this  means  that 


for  all  K  and  K  .  This  is  easy  to  verify  graphically  using  Fig. 

P  * 

2.8. 

Summary 

For  the  bidding  problem  discussed  above,  we  have  found  that  the 
value  of  perfect  information  about  one  state  variable  is  a  function  of 
the  price  of  perfect  information  about  the  other  state  variable.  We 
also  found  that  as  the  price  of  information  about  one  state  variable  de¬ 
clines,  the  value  of  information  about  the  other  increases  to  a  level 
greater  than  that  achieved  by  learning  the  second  state  variable  alone. 

The  Euclidean  space  with  the  prices  of  the  observables  along  the 
axes  (the  "price  diagram")  can  be  divided  into  decision  regions  which 
indicate  the  best  initial  decision.  For  any  given  pair  of  prices,  the 
best  initial  decision,  the  expected  profit,  and  the  value  of  sequential 
information  can  be  found  by  solving  the  appropriate  decision  tree.  The 
decision  tree  can  also  be  used  to  find  the  approximate  boundaries  of  the 
decision  regions,  or,  when  there  are  only  two  observables,  to  find  the 
maximum  prices  that  we  would  pay  initially  to  learn  the  observables. 


CHAPTER  3 


SEQUENTIAL  IMPERFECT  INFORMATION  WITH  ADDITIVE,  CERTAIN  PRICES: 

A  WEATHER  FORECASTING  PROBLEM 

The  preceding  chapter  dealt  with  the  possibility  of  buying  perfect 
information.  In  this  chapter  we  investigate  the  case  of  imperfect  in¬ 
formation  using  a  simple  example  to  illustrate  the  relevant  concepts. 

The  example  addresses  the  problem  of  when  to  pay  for  imperfect  weather 
forecasts  while  trying  to  decide  if  an  activity  should  be  held  indoors 
or  outdoors.  In  this  problem  we  have  the  opportunity  to  buy  two 
conditionally  independent  pieces  of  information,  the  weather  forecasts, 
about  a  single  state  variable  that  describes  the  weather.  The  procedures 
developed  in  this  chapter  can  be  used  when  the  observables  are  not  con¬ 
ditionally  independent,  but  the  example  is  easier  to  follow  and  the  re¬ 
sults  are  clearer  If  we  assume  conditional  independence.  For  simplicity, 
the  example  only  deals  with  the  possibility  of  buying  two  observables 
but  the  analysis  applies  equally  well  when  there  are  more  than  two 
pieces  of  information  available.  Utility  and  risk  aversion  are  not  con¬ 
sidered,  but  it  is  simple  to  extend  the  following  calculations  to  include 
these  concepts.  The  prices  of  the  observables  are  assumed  to  be  additive 
and  certain. 

The  Weather  Forecasting  Problem 

Consider  a  situation  where  we  are  trying  to  decide  whether  to  have 
a  certain  activity  take  place  indoors  or  outdoors.  If  it  rains  we  would 
like  to  have  the  activity  indoors;  if  there  is  fair  weather  we  would  like 


to  have  it  outdoors.  We  assume  that  the  weather  will  either  be  fair  or 
rain.  Since  we  do  not  want  to  sta^e  the  activity  in  the  wrong  location 
we  will  have  to  move  it  if  we  do  not  forecast  the  weather  correctly. 
Once  the  plans  have  been  made  and  the  activity  has  been  set  up,  it  will 
cost  one  unit  (which  could  be  a  dollar,  a  million  dollars,  or  any  other 
amount)  to  move  it  to  another  location.  We  are  being  paid  one  unit  to 
set  up  the  activity  so  our  net  profit,  as  a  function  of  the  location  we 
choose  and  the  weather,  is  given  by  the  following  table: 


Location 

Weather 

Profit 

Indoors 

Rain 

One 

Indoors 

Fair 

Zero 

Outdoors 

Rain 

Zero 

Outdoors 

Fair 

One 

Our  objective  is  to  maximize  our  expected  profit. 

We  can  describe  the  state  of  the  weather  in  terms  of  a  discrete 
random  variable.  Let  x  be  a  random  variable  that  equals  one  if  it 
rains  and  zero  if  it  does  not  rain.  Similarly,  we  can  describe  our 
decision  in  terms  of  a  discrete  control  variable  c  .  Setting  c  equal 
to  zero  Is  equivalent  to  setting  up  the  activity  outdoors,  and  setting 
c  equal  to  one  is  equivalent  to  setting  up  the  activity  Indoors.  Since 
we  wil*  have  a  net  gain  of  one  unit  if  we  do  not  have  to  move  the  activ¬ 
ity  at  the  last  minute,  our  profit  function  is 


TT(x,c) 


1  :  c  -  X  ) 
0  :  otherwise  / 


Since  the  random  variable  x  appears  in  the  profit  function,  x  is  a 


67 


state  variable.  In  this  problem  we  will  not  have  an  opportunity  to  ob¬ 
serve  the  actual  value  of  x  before  we  make  our  decision.  Therefore  x 
is  not  an  observable. 

We  do  not  know  for  certain  if  it  will  rain,  but  we  have  the  option 
of  paying  one  or  more  weather  forecasting  companies  to  learn  what  they 
think  the  weather  will  be.  Assume  that  after  thinking  about  the  problem, 
but  before  buying  a  forecast,  we  decide  that  rain  is  twice  as  likely  as 
fair  weather.  Thus  the  probability  mass  function  for  the  random 
variable  x  is 

{1/3  :  x  •  0 
2/3  :  x  ■  i 
0  :  otherwise 

This  mass  function  is  shown  in  Fig.  3.1. 

After  investigating  the  reputation  of  the  two  weather  forecasting 
companies,  we  have  decided  that  they  are  equally  reliable  and  that  they 
are  correct  607.  of  the  time.  In  other  words  on  days  when  it  actually 
rained  both  companies  predicted  rain  607.  of  the  time.  The  remaining  407. 
of  the  time  they  incorrectly  forecast  fair  weather.  Similarly  on  days 
when  the  weather  was  fair,  both  companies  forecast  fair  weather  607.  of 
the  time  and  rain  40 7,  of  the  time.  Although  the  two  companies  have  the 
same  percentage  of  correct  forecasts,  their  forecasts  for  any  given  day 
do  not  necessarily  agree.  In  tact,  our  investigation  indicates  that,  if 
we  knew  what  the  weather  was  on  a  certain  day,  knowing  one  forecast 
would  not  help  us  guess  the  other  forecast. 

We  can  describe  the  information  contained  in  the  weather  forecasts 
in  terms  of  two  discrete  random  variables,  y^^  and  .  Let  y^^  equal 


68 


one  if  the  first  company  predicts  that  it  will  rain  when  the  activity  is 
set  up,  and  zero  if  that  company  predicts  fair  weather.  Similarly,  y^ 
is  defined  to  be  one  if  the  second  company  forecasts  rain  and  zero  other¬ 
wise.  Based  on  our  investigation,  we  can  describe  our  state  of  informa¬ 


tion  about  y^  and  y ^  in  terms  of  the  following  conditional  probabil¬ 
ity  mass  functions: 


x  =  0  , 
x  =  0  , 
x  =  1  , 
X  -  1  , 


yi  =  1 

yi  =  o 

yt  =  1 


otherwise 


(i  =  1,2) 


Tills  mass  function  is  shown  in  Fig.  3.2.  y^  and  y ^  are  called  ob¬ 
servables  since  we  have  an  opportunity  to  learn  their  actual  values. 

The  Value  of  Individual,  Simultaneous,  and  Sequential  Information 

With  the  problem  formulated  in  this  manner,  we  can  determine  the 
value  of  the  two  weather  forecasts  when  we  learn  them  individually, 
simultaneously,  and  sequentially.  Since  the  procedure  for  doing  so  is 
essentially  similar  to  that  shown  in  the  previous  chapter,  we  will  only 
state  the  results  here.  The  details  of  the  derivation  are  given  in 
Appendix  B. 

The  value  of  learning  the  first  forecast  by  itself  is 

mP  £  "  mfx  g)  tt(x,c)  -  0 

Similarly  the  value  of  learning  the  second  forecast  by  itself  is 

^2  =  (y2  mcX  x  '  "g*  9  n(x»c>  =  0 
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The  value  of  learning  both  forecasts  simultaneously  is 


ny2  '  (n  I  '  ”?*  5>  m  1/75 


The  value  of  learning  the  first  forecast  when  we  have  an  option  to  pay 


K  for  the  second  forecast  is 
*2 


V  (K  )  =  E  max 
yl  y2  yl 


E  max  E  tt(x,c)  -  K 
y2  c  x  y 


max  E  tt(x,c) 


-  max  E  rr(x,c) 


J-  ma 
‘ 


1/75  -  (7/15)  K  :  K  <  1/35 
y2  y2 

0  :  K  >  1/35 

y2  “ 


The  value  of  learning  the  second  forecast  when  we  have  an  option  to  pay 


for  the  first  forecast  is 


V  (K  )  =  E 

y2  y2  y; 


max 


yL  “I*  l  n<x»c) 


max  E  tt(x,c) 


“  max  E  rt(x,c) 


1/75  -  (7/15)  K  :  K  <  1/35 
yi  *1 

0  :  k  >  1/35 

yl  “ 

The  price  diagram  for  this  problem  is  shown  in  Fig.  3.3.  Since 
the  value  of  learning  either  forecast  by  itself  is  zero,  there  are  no 
pairs  of  prices  in  Fig.  3.3  such  that  we  would  buy  either  observable  by 
itself.  We  are  willing  to  buy  both  forecasts  simultaneously  for  any 
pair  of  prices  represented  by  a  point  below  and  to  the  left  of  the  line 
A-B.  (Actually  we  would  always  have  a  higher  expected  profit  if  we 
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purchased  the  forecasts  sequentially  instead  of  simultaneously,  but  the 
idea  here  is  that  buying  both  observables  simultaneously  is  preferable 


to  not  buying  any  information.)  We  are  willing  to  pay  K  for  the 
first  forecast,  with  an  option  to  pay  K  for  the  second  forecast, 

yi 

for  any  pair  of  prices  below  the  line  A-D.  We  are  willing  to  pay  K 
for  y2  ,  with  an  option  to  pay  for  y^  ,  for  any  pair  of  prices 

to  the  left  o(  the  line  C-B.  Therefore  we  are  willing  to  buy  at  least 
one  of  the  forecasts  for  any  pair  of  prices  below  or  to  the  left  of 


the  boundary  C-E-D. 

As  in  the  case  of  perfect  information,  we  can  divide  the  price 
diagram  into  decision  regions  by  comparing  the  increase  in  expected 
profit  associated  with  each  of  the  ways  we  can  buy  the  information.  If 
we  do  so,  we  find  the  decision  regions  shown  in  Fig.  3.4.  The  decision 
regions  are  considerably  different  than  the  ones  we  would  find  if  the 
imperfect  information  were  not  available  sequentially.  In  that  case, 
the  only  decision  region  such  that  we  would  buy  information  is  triangle 
O-A-B  in  Fig.  3.3. 

The  point  of  this  simple  example  is  that  we  deal  with  perfect  and 
imperfect  sequential  information  in  the  same  way,  with  only  minor  changes 
in  the  algebra  used  to  describe  the  value  of  information.  We  can  deter¬ 
mine  the  value  of  sequential  imperfect  information  about  any  observable, 
and  we  can  show  that  it  must  exceed  or  equal  the  value  of  the  same  in¬ 
formation  learned  by  itself  (see  Appendix  B) . 


A  Sequential  Information  Decision  Tree 

Using  Fig.  3.4  we  can  determine  our  best  response  when  we  are 


\ 
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Figure  3.4.  Decision  regions  with  sequential  Information 


offered  the  two  weather  forecasts  at  prices  K  and  K  .  However,  if 

yi  y2 

we  have  a  specific  pair  of  prices  and  want  to  know  what  our  best  decision 
is,  we  do  not  need  to  carry  out  all  of  the  calculations  necessary  to 
determine  the  derisioi  regions.  When  the  prices  are  known,  we  can  carry 
out  a  relatively  simple  calculation  to  find  the  optimal  decision  and  the 
corresponding  expected  profit.  For  the  weather  forecasting  problem 
this  is  equivalent  to  solving  the  decision  tree  shown  in  Fig.  3.5. 

By  solving  the  decision  tree  if  Fig.  3.5  we  can  find  the  best 
decision  associated  with  a  number  of  different  points  in  the  price 
diagram  in  Fig.  3.4.  In  this  way  we  can  determine  the  approximate 
boundaries  of  the  decision  regions  without  carrying  out  all  of  the  cal¬ 
culations  necessary  to  describe  the  decision  regions  algebraically.  For 
sequential  information  problems  with  many  observables,  this  is  often  the 
only  practical  way  to  determine  the  decision  regions. 

When  there  are  only  two  observables  we  can  use  the  decision  tree  in 
Fig.  3.5  to  characterize  the  decision  regions.  We  can  characterize  the 
decision  regions  by  bounding  the  maximum  price  that  we  would  be  willing 
to  pay  for  each  observable  when  our  best  initial  decision  is  to  buy 
that  observable.  The  procedure  for  doing  this  is  similar  to  the  one  for 
perfect  information,  discussed  in  Chapter  2,  and  it  is  carried  out  for 
the  weather  forecasting  problem  In  Appendix  B. 


The  Relationship  Between  Perfect  and  Imperfect  Sequential  Information 
Problems 

We  have  found  that  we  can  deal  with  sequential  imperfect  informa¬ 
tion  in  much  the  same  way  that  we  deal  with  sequential  perfect  informa¬ 
tion.  This  is  not  really  surprising  since  imperfect  information  can  be 
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viewed  as  perfect  information  about  something  other  than  the  state  varia¬ 
bles.  In  fact,  it  is  possible  to  formulate  all  sequential  information 
problems  with  additive,  certain  prices  as  follows.  Let  (x^,...,xm)  be 
the  state  variables  upon  which  the  profit  depends.  The  profit  also  de¬ 
pends  on  a  control  variable  c  which  may  be  a  vector.  Thus, 

tt(x,  , . . .  ,x  ,c)  =  profit  function  that  depends  on  state  and  control 
m  ,  «  - 

variables 

Assume  we  have  an  opportunity  to  learn  any  one  of  a  set  of  random 
variables  (y^,...,yn)  called  observables.  The  cost  of  learning  yt 
Is  Ky  ,  where  i  =  l,...,n  .  Some  of  the  observables  may  be  the  same 
as  some  of  the  state  variables,  in  which  case  we  have  an  opportunity  to 
buy  perfect  information,  but  this  need  not  be  the  case.  Even  if  we  do 
not  have  perfect  information,  we  must  know  how  the  observables  are  re¬ 
lated  to  the  state  variables.  These  relationships  can  be  deterministic 
or  probabilistic. 

Given  this  formulation  we  can  find  the  value  of  learning  an  observ¬ 
able  individually  or  sequentially,  and  we  can  find  the  value  of  learnirg 
several  observables  simultaneously,  regardless  of  whether  the  observaoles 
represent  pe  feet  or  imperfect  information.  For  example,  if  we  are  to  be 
given  only  the  value  of  y^  and  we  do  not  expect  to  receive  any  addi¬ 
tional  information,  our  expected  profit  is 

E  max  E  . . .  E  tt(x-  , . . .  ,x  ) 
y.  c  x,  x  l  m 

i  1  m 

If  y^  represents  imperfect  information,  as  in  the  weather  forecasting 
problem,  this  expression  does  not  need  to  be  simplified.  However,  if  y^ 
is  equal  to  Xj  ,  so  that  y^  represents  perfect  information,  then  we 
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can  simplify  as  follows: 


E  max  E 

yt  c  xj 


. .  E  n(x, , . . .  ,x  ) 
x^  1  m 


=  E  max  E 


C  Xi 


j-1  xj+l 


E  max  E 
xj  c  X1 


E  tt(x.  , 
’Sn  1 


E  TT(x.  , 

’Sn  1 


>x_) 

m 


•  »o 

m 


The  second  E  operator  can  be  dropped  since  it  is  just  the  identity 

Xj 

operator  when  the  expectation  is  conditioned  on  x^  . 

The  last  expression  above  is  the  one  we  used  in  Chapter  2  for  the 

expected  profit  when  we  were  given  perfect  information  about  x^  .  It 

is  easy  to  show  that  all  of  the  other  equations  used  in  Chapter  2  for 

perfect  information  can  be  expressed  i’  terms  of  observables  (y^,...,yn) 

and  state  variables  (x, , • . . ,x  )  .  Thus  this  formulation  can  be  used  to 

v  1  m 

deal  with  both  perfect  and  imperfect  information.  However,  it  is  unneces¬ 
sarily  complicated  then  we  are  only  interested  in  the  value  of  perfect 
information. 


Summary 

We  have  found  that  for  the  weather  forecasting  problem,  the  value 
of  one  piece  oi  imperfect  information  is  a  function  of  the  price  of  the 
other  piece  of  information.  We  also  found  that  the  value  of  information 
received  sequentially  can  exceed  the  value  of  the  same  information  re¬ 
ceived  individually.  As  in  the  case  of  perfect  sequential  information, 
we  can  divide  the  price  diagram  into  decision  regions  that  show  the  best 
initial  information-purchasing  decision.  For  any  given  pair  of  prices 
for  the  two  weather  forecasts  we  can  determine  the  optimum  initial  deci¬ 
sion  by  solving  the  appropriate  decision  tree.  The  decision  tree  can  be 
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usad  to  find  the  approximate  boundaries  of  the  decision  regions.  The 
results  derived  in  this  chapter  for  sequential  imperfect  information 
are  similar  to  those  found >previously  for  sequential  perfect  information. 
In  fact,  we  can  use  the  same  formulation  for  both  tynes  of  problems. 

In  this  formulation,  observables  are  distinguished  from  state  variables 
even  though  they  may  represent  the  same  thing. 
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CHAPTER  4 


GENERAL  PROPERTIES  OF  SEQUENTIAL  INFORMATIOf  PROBLEMS 
WITH  ADDITIVE,  CERTAIN  PRICES 


The  basic  concepts  used  in  solving  sequential  information  problems 
have  been  illustrated  with  examples  in  Chapters  2  and  3.  However,  tne 
solution  of  these  simple  examples  is  not  sufficient  to  demonstrate  sev¬ 
eral  gene  1  properties  of  sequential  information  problems  with  additive, 
certain  prices.  The  purpose  of  this  chap  ir  is  to  generalize  the  re¬ 
sults  of  Chapters  2  and  3,  and  also  to  prove  some  results  that  were  only 
mentioned  in  passing  during  the  discussion  of  the  examples.  For  the 
reader  who  does  not  want  to  read  all  tre  proofs,  the  tumults  are  sum¬ 
marized  at  the  end  of  the  chapter. 

For  simplicity  we  wili  start  by  assuming  that  our  objective  is  to 
maximize  expected  profit.  This  assumption  allows  us  to  ignore  the  effect 
of  risk  aversion,  wh.'ch  only  complicates  the  calculations  without  alter¬ 
ing  the  general  conclusions.  After  studying  the  case  of  an  expected- 
profit  decision  maker,  we  will  show  that  the  conclusions  also  apply  to 
a  decision  maker  whose  utility  function  satisfies  the  delta  property. 

The  problem  of  sequential  information  can  be  formulated  in  general 
as  it  was  at  the  end  of  Chapter  3.  Our  profit  w  is  a  function  of  a 


control  variable  c  and  a  set  of  state  variables  (x, . x  ).  We  have 

l  m 

an  opportunity  to  learn  any  of  a  set  of  observables  (y^ . .  )  for 


prices  (K  . K  ) 

yl  yn 


respectively. 


One  of  the  principal  results  to  come  out  of  the  examples  in  Chapters 
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2  and  3  is  that  the  value  of  sequential  information  about  an  observable 
is,  in  general,  a  function  of  the  prices  of  all  of  the  other  observables. 
Thus , 


V  -  V  (K  . K  ,K  . K  ) 

?i  yi  yt-i  yt+i  yn 

For  simplicity  we  sometimes  write  the  expected  value  of  sequential  in¬ 
formation  about  y^  as 


V 

yi 


>  • 


.  ,K  ) 

yn 


where  it  is  understood  that  V  does  not  depend  on  K  .  It  is  easy 

yi  yi 

to  see  that  this  concept  is  valid,  in  general,  for  any  sequential  informa 
tlon  problem,  although  for  a  given  problem  may  not  he  a  function  of 

some  (or  even  all)  of  the  prices.  The  dependence  of  on  the  prices 

of  the  observables  can  be  seen  in  the  complete  decision  tree  for  the 
problem.  This  tree  is  shown  in  Fig.  4.1.  The  value  of  learning  yt  is 
equal  to  the  difference  between  the  expected  profit  associated  with 
branch  (the  branch  where  we  first  learn  y^)  in  Fig.  4.1b,  and  the 

expected  profit  associated  with  branch  Bq  (the  branch  where  we  do  not 
learn  any  information).  The  cost  of  initially  learning  y^  is  shown  in 
Fig.  4.1a,  and  is  not  included  in  the  branches  in  Fig.  4.1b.  Thus,  sub¬ 
tracting  the  expected  values  associated  with  the  branches  in  Fig.  4.1b 
yields  the  desired  expected  values  of  information. 

The  value  of  learning  y^  sequentially  when  we  are  trying  to  maxi¬ 
mize  expected  prof.t  is  given  by  the  following  algebraic  expression 
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Figure  4.1«. 


Sequential  Information  decision  tree  for  an 
expected-profit  declafon  aakar 
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Sequential  information  decision  tree  for  an  expected  profit  decision  maker  (continued) 


9  *  *  *  9 


max 


^  tt(x^  )  •  ■  •  jX  ,c) 


m 


max 


max  E 
c  x^ 


(E  max 
?k 


max  E  . . . 
c  X1 


E 

xm 


nCxj^ 


»X  >C> 
m 


In  keeping  with  the  notation  introduced  previously,  each  expectation  is 
conditioned  on  the  random  variables  that  appear  as  subscripts  of  operators 
that  are  applied  to  the  expectation  in  question.  For  exanple,  all  of  the 
expectations  in  the  expression  above,  except  those  in  the  final  term  that 
is  subtracted  from  the  rest  of  the  expression,  are  conditioned  on  yt  . 
Since  all  of  the  costs  except  appear  on  the  right  side  of  this 

equation,  must  be  a  function  of  all  of  the  costs  except  K 

When  we  are  trying  to  decide  whether  or  not  to  pay  for  y±  ,  wa  must 
know  all  the  costs,  including  ,  because  we  will  only  buy  the  in¬ 

formation  when 


<  V .  (K 


The  Relative  Values  of  Individual,  Simultaneous,  and  Sequential  Information 
It  is  easy  to  show  that  V  must  exceed  or  equal  the  value  of 

individual  information  about  y.  for  any  set  of  prices  (K  jr  \ 

^  ,  yl’"',yn 

The  value  of  individual  information  is  given  by 
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-  -  -*■ 


V  ■  E  max  E  .  . .  E  tt  -  max  E 

yl  C  X1  C  X1 


Obviously,  for  any  set  of  prices 


D  max 


T 5i  -K* 


max  E 


b  •  •  •  m 

c  *i  *m 
max  (E  max 

kfi.J  yk 


max  E 
c  x. 


.  .  E  TT 
X 
m 


Taking  the  expected  value  with  respect  to  y^  of  both  sides  of  this  in¬ 
equality  and  subtracting  the  expected  profit  when  no  information  is  pur¬ 
chased  yields 


V  (K  ,K  )  >  V 

V  V  '  V  '  V  9  '  \T  — 


yi  yl 


yi-l  yi+l 


We  can  also  show  thai.  the  value  of  sequential  information  about 
y^  also  exceeds  the  residual  value  of  information  about  y^  when  all 
of  the  information  is  purchased  simultaneously.  (We  could  also  consider 
the  residual  value  of  learning  y^  when  we  buy  information  simulta¬ 
neously  about  all  pairs,  triples,  etc.,  of  observables.  However,  we 
will  only  consider  the  possibility  of  buying  all  of  the  observables 
simultaneously.)  This  requires  a  littlo  mbre  work,  but  the  proof  is 
essentially  similar  to  the  one  above.  The  residual  value  of  information 
about  y^  is  given  by 

(K . K  ,K  ,...,K  )  ■  II  (E  )  max  E  ...  E  TT 

yi  yi  yi-i  y^i’  yn  *  yk  c  xi  *m 


kfi 
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To  save  space  we  are  using  the  following  abbreviations: 


and  (D  )  -  D  . .  .  D 


Vfl  'yk-  yx 


yj-l  yj+l 


..  D 


We  start  the  proof  by  noticing  that  for  any  /  i 

&  11  •( 

h 


4  (V 


max  E 
c  x. 


m 


max 


E  max  E  . . .  E  tt 
y,  c  x  x 

Jl  1  tn 


-K  j 


>  .  D ’  (D  )  E  max  E  .  . .  E  tt  -  K 
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Let  be  the  value  of  that  maximizes 


kU>  (D  )  E  max  E  . . .  g  TT  -  IC 
kfJl  yk  yjL  C  X1  y 


Since  the  inequality  above  holds  for  all  values  of  not  equal  to  i 


kPjt  <V 
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1  tn 


max  J  . . .  E 

jf  C  X1  «■ 


TT  -  K 


-A  V  V?x  "i  •••  i>_  ^ 


jf 


Now  take  the  expected  value  of  both  sides  of  this  inequality  with  respect 

to  y,  ,  given  all  of  the  other  observables  except  y  .  --where  j0  does 

J2  Jf  * 

not  equal  or  i  — and  subtract  .  This  yields 
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Therefore, 
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Now  repeat  the  process.  Let  jj  be  the  value  of  J2  that  maxi¬ 
mizes 


Since  the  Inequality  above  holds  for  all  values  of  J2  not  equal  to 
Jf  or  1  : 
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E  max  E  . . .  E  n  -  K 

yjf  c  xi  V  yjf 


-  *  1 
v ...  ' 
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*  i% 


(D  )  E  E  max  E  . .  .  E  TT  -  K  -  K 

'  IT  '  IT  It  V  V  *» 


j2  yk  yj$  yjf  c  * 


y1*  y1* 


Next  we  take  the  expected  value  of  both  sides  of  this  inequality  with 
respect  to  v.  given  all  of  the  other  observables  except  y  .  and 

J3  Jf 

y  .  --where  j_  does  not  equal  jf  ,  j*  ,  or  i  --and  subtract  K 
j*  3  12  yj3 

The  process  is  repeated  until  all  of  the  observables  except  y^ 

have  been  included  in  the  inequality.  At  that  point  the  inequality  is 


D  max 


max  E  .  .  .  E  TT 
c  x.  ” 


max  E  ... 
c  x^ 


(•••I  -  Y 


>  D  K  E 

-  yt  /j*  yj* 

Jn  Jn-1 


E  max  E 
y1*  C  X1 


.  E  TT  -  K 

x  y  i* 

m  j* 


Since  all  of  the  indices,  (jj  ,  ....  j*  ,  must  be  different  and  none 

can  be  equal  to  i  ,  the  right  side  of  this  inequality  can  be  written 


D  .  II  (E  )  max  E  . . .  E  TT  -  fyf.  K 

y.  'y'  c  x,  x  kfi  > 

i  K  L  m 


To  save  space  we  are  using  the  following  abbreviation 


.H  ( E  )  -  E  , . . .  ,E 

Ml  yk  yl  yi.l 


,E  , . . .  ,E 


Using  the  definition  of  the  starred  indices,  we  have 


max 
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&  " 
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D  max 
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max ,  (  E 


(  max  E 

1  p  V 

E  n  )  v 

max  < 

J  C  X1 
\  X 

™  >  -K  ] 
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E  . 
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^  K 

X1 

A  yk 

Taking  the  expected  value  with  respect  to  of  bo ths  sides  of  this  in¬ 

equality,  and  subtracting  the  expected  profit  when  no  information  is 
purchased,  yields 


K  ) 


for  any  set  of  prices  (K  ,  ...,  K  )  . 

yl  mi 

These  inequalities  agree  with  our  intuition  about  the  value  of  se¬ 
quential  information.  When  we  buy  a  piece  of  information  with  an  option 
to  subsequently  buy  other  observables ,  we  have  already  been  given  the 
option  of  buying  just  one  observable,  or  of  buying  all  of  the  information. 
Thus  the  value  of  sequential  information  should  be  at  least  as  large  as 
the  value  of  individual  information  and  the  residual  value  of  informa¬ 
tion.  We  can  always  achieve  the  expected  profit  associated  with  indi¬ 
vidual  and  simultaneous  information  by  making  the  proper  set  of  sequen¬ 
tial  decisions.  The  same  kind  of  reasoning  shows  that  the  value  of  se¬ 
quential  information  of  y^  must  exceed  the  residual  value  of  y^  , 
when  we  buy  information  simultaneously  abour  all  pairs,  triples,  etc., 
of  observables.  Thus  it  is  possible  to  prove  a  large  number  of 
inequalities  of  the  form 
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was 


V  >  -  K  and  V  >  VN  -  K  -  K 

yi'  yiyj  yj  yi"  Wk  \ 


i  'j'k  'J 


An  interestiv.o  feature  of  the  examples  in  Chapters  2  aid  3 

N  R 

that  could  exceed  both  Vy^  and  Vy^  for  certain  sets  of  prices. 

It  is  this  feature  that  makes  it  desirable  for  us  to  buy  sequential 

information  at  prices  that  would  be  unacceptable  if  the  information 

were  available  only  individually  or  simultaneously.  Intuitively,  we 

see  that  Vy^  can  exceed  both  Vy^  and  whenever  learning  y^ 

can  affect  our  decision  to  learn  the  other  observables.  If  yt  can 

help  us  decide  which  pieces  of  information  to  buy,  as  well  as  how  to 

set  the  control  variable,  then  it  should  be  worth  more  than  it  would 

if  there  were  no  subsequent  information-purchasing  decision. 

It  is  easy  to  see  that  this  intuitive  answer  is  correct.  Suppose 

that  for  some  set  of  prices  (K  ,...,K  )  ,  learning  y  tould  affect 

“1  1 

our  decision  to  learn  the  other  observables.  In  other  words,  when  we 
learn  that  y^  is  equal  to  y*  we  can  maximize  our  expected  profit  by 
nsklng  a  certain  decision.  This  decision  might  be  to  learn  a  particular 
observable  next,  or  it  might  be  to  not  learn  any  more  information.  How¬ 
ever,  if  we  learn  that  yt  has  a  different  value,  y**  ,  we  will  be 
able  to  realize  a  greater  expected  profit  by  changing  our  decision. 

Since  the  best  information-purchasing  decisions  that  result  when 
we  learn  that  yj^  equals  y*  or  y**  are  different,  at  least  one  of 
the  decisions  must  be  to  buy  additional  information.  Therefors  we  have 
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max 


(  max  E  . .  .  E  TT 
c  Xl  “ 

(k^j  l-l 
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*  " 


for  some  J  when  yt  equals  either  y*  or  y**  .  Thus  for  the  same 
conditions  we  have 


D  max 
*i 


max  E  . . .  E  rr 
c  Xi  *•_ 
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max  E  . . .  g  TT 

IkWh  (?k”*x  |-"t 


>  D  max  E 
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Using  our  previous  results,  T<e  can  take  the  expected  value  of  both  sides 
of  this  inequality  with  respect  to  y^  and  subtract  the  expected  profit 
when  no  Information  is  purchased  to  get 


•  •  •  » 


>  •  •  •  9 


K  )  >  V 


,N 

*i 


On  the  other  hand,  the  best  information-purchasing  decisions  that 
result  when  we  learn  that  y±  equals  y*  or  y**  cannot  both  lead  to 
buying  all  of  the  remaining 'pieces  of  information  regardless  of  what  the 
Information  turns  out  to  be.  If  that  happened,  the  two  decisions  would 
lead  to  the  same  expected  profit,  and  thj're  would  be  no  reason  to  change 
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the  information-purchasing  decision  when  y£  changes  from  y*  to  y**  . 

Thus  when  the  observables  turn  out  to  have  certain  values  (y  v  v  ^ 

J1  *yj2’  ’  * *'  ’ 

and  we  make  the  corresponding  optimum  Information-purchasing  decisions, 
it  must  be  true  that 
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TT 
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for  some 


when  yt  equr’s  y*  or  y**  . 


Thus,  for  the  same  conditions  we  have 


Now  wo  can  go  through  the  same  process  which  we  used  to  show  that  V  > 

y£  ’  except  that  this  tim*  all  the  inequalities  are  strict.  We  keep1 
adding  observables  until  we  have 
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(max  E  . . . 
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b?uh  yj2  1  yj2 


>  D 
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(E  )  max  E 
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E  TT  -  £  K. 
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k^i  yk 


when  y^  equals  y*  or 


v** 

yi 


Using  our  previous  results,  we  can  take  the  expected  value  with  respect 
to  of  both  sides  of  this  inequality,  and  subtract  the  expected 

profit  when  no  information  is  received,  to  gat 


K  ) 


n 


>V* 

y^ 


(K 


Thus  for  any  given  set  of  prices,  will  exceed  both  and 

V*  whenever  learning  y,  could  affect  our  decision  to  learn  the  other 
yi  1 

observables. 


Properties  of  the  Value  of  Sequential  Information 

Now  that  we  have  shown  that  V  is  a  function  of  the  set  of  prices 
f _  K  t  k  ,  . . . ,  K  )  ,  we  can  determine  some  general  proper¬ 

ties  of  this  function.  More  specifically,  we  can  show  that  as  any  one  of 

the  prices  increases,  V  cannot  increase.  In  fact,  it  may  decrease  but, 

yi 

if  the  decision  is  based  on  maximizing  expected  profit,  it  cannot  decrease 
by  more  than  the  amount  that  the  price  increases.  This  result  follows 
from  the  form  of  ‘"he  equation  for  , 
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j  (max  (E  maxi.  . K 

kn.J  yk  '  ’  : 
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max  E 
c  X1 


Each  price,  except  K  ,  appears  in  this  expression,  and  each  time  the 

yi 

price  is  subtracted  from  some  quantity.  Thus  we  would  expect  the  deriva¬ 
tive  of  Vy  with  respect  to  one  of  the  prices  to  be  the  expected  value 
of  terms  that  are  either  zero  or  minus  one. 

We  can  carry  out  the  ditferentiation  by  using  the  fact  that  the 
derivative  of  the  expected  value  is  equal  to  the  expected  value  of  the 
derivative , 


dV  /  max  E  ... 

ji.  p  _a_  I  c  *1 

3K  y.  3K  max 
y  ya 
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r 

mjx  (E^  max  j...|-  K^)J 


0  :  D  max  E  . . .  E  tt  >  D  max  (E  max  j . 
yi  c  X1  xn  "  yi  J*  yj  1 

— max  (E  maxi...}-  K  )  :  otherwise 
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Let  j*  be  the  value  of  j  that  maximizes 
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max  E 
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and  assume  for  a  moment  that  j*  is  unique.  In  this  case  the  deriva¬ 
tive  becomes 
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0  :  D  max  E  .  . .  E  >  D  E  max] . 
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K  :  otherwise 
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If  j*  equals  a  ,  we  have 


0  :  D  mgx  E 


i  I  •  1  !  otherwise 

a  v 


E  TT  >  D  E  max  {...(-  K 
n  ,  yi  ya  a 


The  expected  value  of  a  quantity  that  is  everywhere  either  0  or  -1 
must  lie the  closed  interval  bounded  by  these  numbers.  Therefore, 


€  [-1,0] 


Now  consider  what  happens  to  SV  /dK  as  K  increases.  Let 

yi  ya  ya 

<p^(K  )  be  the  set  of  all  y^  such  that  the  condition  in  the  equation 

for  av  /dK  is  met: 

yi  ya 

^(K  )  -  [yt  :  K  >  D  f  max  J. .  .\  -  D  max  E  ...  |  r] 
ya  nr  3a  i  n 


We  can  rewrite  the  derivative  of  V  as  follows: 

yi 


- 1  -  e 

BKy  yt 
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0  :  yt  e  ) 


-1  :  otherwise 


Assume  that  y°  belongs  to  <p,  (K  )  ,  and  let  K'  be  some  price  larger 
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K 1  >  K  >  D  E  max  1 ...  I  -  D  max  E  . . .  E  rr 

y<*  “  y?  y«  1  f  yi  c  xi  \ 

Therefore,  y°  belongs  to  cpl(Kl  )  as  well  as  qj.  (K  )  .  Since  this 

holds  for  any  y°  that  belongs  to  9,(K  ) 
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whenever 


K'  >  K 


( ° ;  n  •  vv 

3«y  '  ^ 

a  ^  - 1  :  otherwise  J 


0  :  Vi  c  9l«)  c  n(K'  ) 


-1  :  otherwise 


In  other  words,  3V  /8K  can  never  decrease  when  K  increases. 

yi  y<*  ya 

This  result  can  also  be  written  as  follows: 


i>° 


If  j*  is  not  unique,  we  have  a  situation  where  exactly  the  same 
expected  profit  is  associated  with  two  o;  more  branches  at  the  same  node 
in  the  . decision  tree.  This  is  shown  in  Vig.  4.2.  The  same  expected 

profit  occurs  at  branches  B  and  B.  for  some  value  of  K  ,  which 

o  a  P  yO 

we  call  K  .  As  we  change  K  we  will  change  our  decision  at  the 

ya  y» 
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Figure  A. 2b.  Value  of  Information  associated  with  branch  B,  when  branch  B 

i  a 

is  always  chosen,  and  when  Bg  is  always  chosen. 


Figure  A. 2c.  First  derivative  of  value  of  information  associated  with 
branch  Bt  when  branch  B  Is  always  chosen,  and  when 
branch  Bg  Is  always  chosen. 


Figure  A. 2d.  Second  derivative  of  value  of  information  associated 
with  v ranch  B^  when  branch  ta  is  always  chosen,  and 
when  branch  is  always  chosen. 
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-  JCr' 


node  in  question  and  choose  a  different  branch.  If  we  look  at  the  ex¬ 
pert"'*  profit  and  the  corresponding  value  of  information  associated  with 
branch  B.  ,  assuming  that  branch  B  is  always  chosen  over  branch  BQ  , 
and  vice  versa,  we  must  have  a  graph  such  as  that  shown  in  Fig.  2.4b. 
Since  the  proof  above  holds  for  any  tree  branches,  both  of  the  curves  in 
Fig.  4.2b  must  have  first  derivatives  in  the  interval  [-1,0],  and  posi¬ 
tive  second  derivatives.  This  is  shown  in  Fig.  4.2c  and  4. 2d.  In  order 
for  the  value  of  information  curves  in  Fig.  4.2b  to  cro6S,  the  slope  of 
the  B  curve  must  be  less  than  the  slope  of  the  B.  curve  at  K° 

a  p  y  a 

When  we  have  a  choice  between  branches  B^  and  BQ  ,  we  will  have 

a  p 

the  value  of  information  that  is  the  envelope  of  the  curves  in  Fig.  4.2b. 

This  can  result  in  e  discontinuous  first  derivative,  as  shown  by  the 

solid  curve  in  Fig.  4.2c.  Since  the  slope  of  the  B  curve  must  be 

a 

less  than  the  slope  of  the  B_  curve  when  K  equals  K°  in  Fig. 

“  y»  y<x 

4.2b,  the  first  derivative  must  increase  at  the  discontinuity.  There¬ 
fore,  the  second  derivative  can  contain  a  positive  impulse,  as  shown  by 
the  solid  curve  in  Fig.  4. 2d.  However,  neither  the  discontinuity  in 
dV  /dK  nor  the  impulse  in  /BK  ^  invalidate  the  statement  that 
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' a 


' a 


av., 


S2v 
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e  [-1,0]  and 
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1  Z 


>  0 


CK 


We  car  reach  the  same  conclusion  algebraically,  but  the  method  of 
proof  is  exactly  the  same  as  the  graphical  argument  given  above.  To 
avoid  unnecessary  complication,  we  will  not  go  through  the  algebraic 
proof.  (Using  an  algebraic  proof  we  can  show  that  3V  /^K  can  make 

?i  y<* 
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a  discontinuous  jump  to  lower  value  as  K  increases,  Thus  , 

yg 

2 

d  V  />K  can  contain  a  finite  number  of  negative  impulses,  but 

yi  ya  yP 

it  is  non-negative  elsewhere.) 

In  our  proof  that  the  first  and  second  derivatives  of  V  had 

yi 

certain  properties,  we  assumed  that  j*  was  equal  to  a  .  If  j*  does 
not  equal  a  we  will  still  get  the  same  conditions  for  av  /^K  and 

yi  ya 

2  2  “ 

9  V  /gK  ,  but  it  will  require  some  more  effort.  In  this  case, 
yi  ya 
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(To  save  space,  the  condition  "otherwise"  is  dropped  when  the  meaning  of 
the  expression  is  clear.)  Let  k*  be  the  value  of  k  that  maximizes 
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and  assume  for  a  moment  that  k*  is  unique.  Thus  the  derivative  be¬ 
comes 
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If  k*  =  a  ,  we  have 
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0  :  yl  e  ,Pl<KyJ,) 


0  :  D  D  max  E 
yiyj*C  X1 

-1  :  otherwise 
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Define  0(K  )  as  follows 
ya 


0  (K  ) 
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Ja 


=  D  E 
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0  :  D  D  max  E 
yiyj*  c  X1 

-1  :  otherwise 


E  TT  >  D  D  E  max 
Xn  "  yiyj*ya 


The  expected  value  of  a  quantity  that  is  everywhere  either  0  or  -1 
must  lie  in  the  closed  interval  bounded  by  these  numbers.  Therefore, 

0(K  )  e  [-1,0] 

ya 


The  derivative  of  V  can  be  written  as  follows: 

yi 


0 :  yi £  ) 

0(K  )  :  otherwise  j 

y<v  / 


The  expected  value  of  a  quantity  that  is  everywhere  in  the  interval 
[-1,0]  must  lie  in  this  interval.  Therefore, 

avy 

TT7~  «  [-1,0] 
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Now  consider  what  happens  to  SV  /^K  as  K  increases.  Let 

yi  yc*  y a 

92(K^  )  be  the  set  of  all  (y^yj*)  such  that  the  condition  in  the 

equation  for  9(K  )  is  met. 
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We  can  rewrite  the  equation  for  0(K  )  as  follows: 
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-1  :  otherwise 


Assume  that  (y  iy.J  belongs  to  cp-(K  )  ,  and  let  K'  be  some  price 

1  J  2  ya  ya 

larger  than  K  .  Then, 
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Therefore  (y°,y°*)  belongs  to  cp  (K*  )  as  well  as  to  cp  (K  ) 
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a  J a 

Since  this  is  true  for  any  (y°,y°  )  that  belongs  to  cp„(K  ) 

1  J  T2  yJ 


92(K  )  e  cp  (K*  ) 

J  cy  Jet 


i 


whenever  K'  >  K 

y<x  Vq 


8(K'  )  =  D  E 
yc  yi  yj* 


So , 


f°  :  (y^yj*)  €  cp2(K’^) 


■1  :  otherwise 


>  D 
‘  yi 


(y^y*  )  c  <p2(k  )  c  <p2(k'  ) 
J  ya  y  a 

otherwise 


This  follows  from  the  fact  that  the  expected  value  of  a  quantity  cannot 
decrease  when  the  quantity  is  increased  or  held  constant.  Thus 
BV  /3K  cannot  decrease  when  K  increases,  and  we  can  write 

yi  ya  y a 


3Ky 


T.Z 


>  0 


a 


If  k*  is  not  unique,  we  have  a  situation  where  exactly  the  same 


expected  profit  is  associated  with  two  or  more  branches  at  the  same  node 
of  the  decision  tree.  The  same  argument  that  we  used  previously  shows 
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2  2 

that  SV  /*K  can  have  a  disconti  luity,  and  that  $  V  /?iK  can 

yi  ya  yi  ya 

have  a  positive  impulse  at  the  value  of  K  where  the  expected  profits 

ya 

of  the  branches  are  equal.  However,  it  is  still  true  that 


3V 

V  V 

Tk/  ' 


[-1,0] 


and 


If  k*  does  not  equal  a  ,  we  repeat  the  procedure,  adding  new  ob¬ 


servables  until  we  find  one  that  maximizes  the  appropriate  expression 


and  is  equal  to  ya  .  This  must  occur  within  n  iterations  since  each 


observable  we  add  must  be  different  from  all  of  the  preceding  observ¬ 


ables.  When  we  finally  get  an  expression  for  dV  /SK  that  contains 

yi  ya 

K  ,  it  will  look  like  this  : 

ya 


/  0  :  yt  « 


n* 


:  <VV  «  W 

0  :  e  TjOCy^) 


rk* 


E 

ya 


o  :  <W--->  • 

i 


r 

'  -1  : 


otherwise 


Following  the  procedures  used  previously  we  can  show  that  th'>  innermost 
expectation  must  lie  in  the  interval  [-1,0],  and  that  it  will  not  de¬ 
crease  when  K  increases.  Then  we  can  work  back  through  the  other  ex- 
ya 

pec  ted  values  to  show  that 


d2v 


=K 


j  [-1,0]  and 


a 


dK 


2  - 


>  0 


ya 
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The  Number  of  Calculations  Required  to  Determine  the  Value  Functions 


and  Decision  Regions 

Unless  a  sequential  information  problem  is  very  simple,  the  number 
of  calculations  required  to  determine  the  decision  regions  is  prohibi¬ 
tively  large.  Furthermore,  when  there  are  more  than  three  observables 
it  becomes  very  difficult  to  even  visualize  the  decision  regions  be¬ 
cause  they  occupy  a  space  of  more  than  three  dimensions. 

How  many  calculations  are  required  to  determine  the  decision 
regions  in  a  problem  with  n  observables?  To  answer  this  question, 
consider  a  problem  with  three  observables.  Following  the  procedure 
developed  in  Chapters  2  and  3,  we  first  analyze  the  decision  of  whether 
or  not  to  buy  information  about  one  observable  when  we  already  know  the 
other  two.  The  solution  to  this  problem  is  a  function  of  the  two  observ¬ 
ables  that  we  already  know.  There  are  three  subordinate  decision  prob¬ 
lems  of  this  type  corresponding  to  the  three  observables.  Figure  4.3 
shows  a  simplified  decision  tree  for  this  problem  with  branches  that 
lead  to  the  same  state  of  information  connected  togeter.  (It  is  a  fea¬ 
ture  of  decision  problems  that  different  sets  of  decisions  can  lead  to 
the  same  state  of  information,  This  feature  is  called  "coalescence." 

In  terms  of  decision  trees,  coalescence  means  that  different  branches 
can  be  connected  since  they  are  identical  beyond  a  certain  point.)  The 
nodes  at  which  we  must  solve  a  subordinate,  information-purchasing  deci¬ 
sion  problem  are  surrounded  by  small  rectangles.  The  three  subordinate 
decision  problems  discussed  above  are  Nodes  5,  6,  and  7  in  Fig.  4.3. 

Next  we  back  up  one  step  and  consider  the  information-purchasing 
decisions  at  those  nodes  where  we  know  one  of  the  observables.  At  these 
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nodes  we  are  trying  to  decide  which,  if  any,  of  the  remaining  two  ob¬ 
servables  to  buy.  The  expected  profit  associated  with  learning  another 
observable  is  given  by  the  solutions  of  the  previous  set  of  subordinate 
decision  problems,  the  ones  where  we  assumed  that  we  knew  two  of  the  ob¬ 
servables.  There  are  three  subordinate  decision  problems  where  we  only 
know  one  of  the  observables,  and  the  solution  to  each  of  these  problems 
is  a  function  of  the  one  observable  that  is  known.  These  three  sub¬ 
ordinate  decision  problems  correspond  to  Nodes  2,  3,  and  4  in  Fig.  4.3. 

Finally  we  have  to  back  up  to  the  first  node  in  the  d^lsion  tree 
(Node  1  in  Fig.  4.3)  and  decide  which  piece  of  information,  if  any,  to 
buy  first.  The  expected  profit  associated  with  learning  any  observable 
is  given  by  the  solutions  to  the  previous  subordinate  uecision  problems. 

When  we  solve  all  of  the  subordinate  decision  problems  associated 
with  the  nodes  in  Fig.  4.3,  we  will  have  the  inequalities  that  describe 
the  decision  regions  in  n-dimensional  space.  If  we  solve  all  of  the  sub¬ 
ordinate  decision  problems  except  the  first  one  (Node  1  in  Fig.  4.3), 
take  the  appropriate  expected  values,  and  then  difference  the  results, 
we  will  have  ^(K^.K^.X^)  for  i  -  1,2,3  .  For  the  problem  with 
three  observables ;  this  means  that  we  need  to  solve  six  subordinate  deci¬ 
sion  problems  to  find  the  value  of  sequential  information  about  each  of 
the  observables.  We  must  solve  one  more  decision  problem  to  determine 
the  decision  regions. 

If  we  have  a  decision  problem  with  n  observables,  we  will  have 
to  solve  n  subordinate  decision  problems  where  we  assume  that  we  know 
all  but  one  of  the  observables.  This  is  followed  by  n(n-l)/2  sub¬ 
ordinate  decision  problems  where  we  assume  that  we  know  all  but  two  of 
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the  observables .  In  general,  if  we  assume  that  we  know  k  observables, 
we  will  have 


\ky  k.'(n-k)! 

subordinate  deeislon  problems  to  solve.  This  la  the  number  of  combina¬ 
tions  of  n  distinct  things  that  we  can  take  k  at  a  time.  Since  we 
must  solve  these  decision  problems  for  k  -  2,3, . . .  ,(„-l)  to  find 

Wl . V,-y+i . Kyn>  .  "e  "HI  have  to  solve  a  total  of 

v  (!)  -  «■  -  » 

subordinate  decision  problems.  To  determine  the  decision  regions  (or 
decision  sets  1^  )  we  will  need  to  solve  one  more  subordinate  decl- 
sion  problem  for  a  total  of  (2n  -  1)  problems. 

Approximating  and  Characterizing  the  Decision  Regions 

As  we  have  seen,  a  large  number  of  calculations  are  required  to 
determine  the  value  functions  and  the  associated  decision  regions  when 
there  are  many  observables.  Since  the  value  of  sequential  information 
and  the  boundaries  of  the  decision  regions  are  described  by  algebraic 
functions.  t.»ie  calculations  required  to  determine  them  are  algebraic 

rather  than  numeric.  Therefore  it  is  difficult  to  program  a  computer  to 
carry  out  v:he  calculations. 

However,  we  can  use  the  decision  tree  in  Fig.  4.1  to  determine 

Vyi (Kyi ’ *  *  * ,Kyi_ 1  ,kyi+1  *  *  *  * ,Kyn)  >  for  i  =  1 . .  ,  and  the  best  ini¬ 

tial  information-purchasing  decision  whenever  we  have  a  specific  set  of 


prices  (K  , . . . ,K  )  .  The  calculations  required  to  solve  the  decision 

VI  yn 

tree  are  numeric,  and  a  computer  program  can  be  written  to  solve  the  de¬ 
cision  tree.  Any  computer  program  that  solves  the  decision  tree  for  a 
sequential  information  problem  with  n  observables  must  solve  (2°  -  1) 
subordinate  decision  problems  to  determine  the  value  of  information  and 
the  best  initial  information-purchasing  decision.  However,  each  sub¬ 
ordinate  decision  problem  can  be  solved  by  simply  comparing  numbers  and 
choosing  the  largest  one.  This  corresponds  to  picking  the  branch  with 
the  highest  expected  profit  at  each  node  of  the  simplified  decision  tree 
in  Fig.  4.3. 

By  solving  the  decision  tree  in  Fig.  4.1  with  a  specific  set  of 
prices  for  the  observables,  we  are  determining  the  optimum  decision  at 
one  point  in  the  price  diagram.  By  repeating  the  calculation  for  a 
number  of  different  sets  of  prices,  we  can  determine  the  approximate 
boundaries  of  the  decision  regions.  The  values  of  individual  and 
simultaneous  information  can  be  used  to  determine  the  sets  of  prices 
that  would  be  most  useful  in  determining  the  decision  regions.  For 
examp le,  if  we  had  determined  ,  and  for  a  problem  with 

yi  y2  ym 

two  observables,  as  shown  in  Fig.  4.4,  we  would  want  to  solve  the  deci¬ 
sion  tree  with  sets  of  prices  represented  by  points  in  the  region  R  to 
see  if  we  would  be  willing  to  buy  information  in  that  region. 

The  values  of  individual  and  simultaneous  information  can  be  deter¬ 
mined  numerically  using  the  decision  tree  in  ’’ig.  4.1  and  an  appropriate 
computer  program.  The  expected  profit  when  no  information  is  purchased 
can  be  found  by  solving  the  decision  tree  with  all  of  the  prices  of  the 
observables  set  equal  to  infinity  (or  some  very  large  number).  is 
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equal  to  the  increase  in  expected  profit  that  results  from  setting  Ky 

N 

equal  to  zero  and  all  of  the  other  prices  equal  to  infinity.  V 

M  yi---yn 

is  the  increase  in  expected  profit  that  results  from  setting  all  of  the 
prices  equal  to  zero. 

Another  way  to  use  the  decision  tree  to  characterize  the  decision 

regions  is  by  bounding  the  maximum  value  that  V  (K  , . . . ,K  )  could 

yi  yl  yn 

have  when  our  best  initial  decis<on  is  to  learn  yt  .  This  maximum 
value  can  be  used  as  an  upper  bound  for  the  amount  that  we  would  be  will¬ 
ing  to  pay  to  learn  y^  first,  regardless  of  what  the  prices  of  the 
other  observables  are.  The  upper  bound  allows  us  to  exclude  from  consid 
eration  any  initial  purchase  of  information  that  costs  more  than  the 
bound,  without  considering  the  price  of  each  observable. 

It  is  easy  to  show  that  the  value  of  simultaneous  information  about 
all  of  the  observables  is  an  upper  bound  for  the  maximum  value  of  sequen¬ 
tial  information  about  any  one  of  the  observables.  When  the  prices  of 

N 

the  observables  are  all  set  equal  to  zero,  V  equals  V 

y±  yi-'-'n 

This  can  be  seen  from  the  decision  tree  in  Fig.  4.1.  Since  all  of  the 
information  is  free,  we  will  continue  to  accep."  one  piece  of  informa¬ 
tion  after  another  until  we  have  received  it  all,  regardless  of  which  ob¬ 
servable  we  learn  first.  In  this  case  the  expected  profit  associated 
with  learning  all  of  the  observables  simultaneously  equals  the  expected 
profit  associated  with  learning  them  sequentially  in  any  order.  There¬ 
fore, 

V  (0,0,. ..,0)  =  (i  -  1 . n) 

yi  yl---yn 


As  we  increase  each  of  the  prices  to  any  positive  quantity, 


cannot 
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increase  since  /3k  is  less  than  or  equal  to  zero.  Thus, 

yi  yj 


v  (K^ . K  )  <  v 

yi  yl  yn  y 1 ' ‘ ‘ yn 


Since  V*  is  an  upper  bound  for  V  for  all  sets  of  positive 

yi--*yn  yi  F 

prices,  it  must  also  be  an  upper  bound  for  over  the  set  of  prices 

where  our  best  Initial  decision  is  to  learn  y^  . 

Unfortunately,  ^  is  not  a  very  tight  upper  bound  for  the 

maximum  value  that  V  can  have  when  our  best  initial  decision  is  to 

yi 

learn  y^  .  To  find  this  maximum  value,  we  have  to  maximize  sub¬ 

ject  to  the  constraint  that  the  Increase  in  expected  profit  resulting 
from  learning  y^  must  be  positive  and  must  exceed  the  increase  in  ex¬ 
pected  profit  resulting  from  learning  any  other  observable.  When  there 
are  more  than  two  observables  this  is  a  very  difficult  optimization 
problem. 

In  addition,  when  there  are  three  or  more  observables  it  is  possible 
that  the  set  of  prices  that  maximizes  K  subject  to 

<vv  -  K  )  >  (V  -  K  ) 

yi  yi  yk  yk 


for  all  k  not  equal  to  i  ,  and 


(V  -  K  )  >  0 
yi  yl  " 

is  not  the  same  as  the  set  of  prices  that  maximizes  subject  to 


(V  -  K  )  *  (V  -  K  ) 
yj  yj  yk  yk 


for  all  k  not  equal  to  j  ,  and 


-  v  2  0 


m 


In  other  words,  there  need  not  be  a  unique  point  in  the  n-dimensional 
price  diagram  where  the  price  of  each  observable  is  maximized  over  the 
decision  region  corresponding  to  that  observable,  even  when  there  are  no 
sets  of  prices  such  that  the  best  initial  decision  is  to  buy  several 
pieces  of  information  simultaneously. 

(If  the  best  initial  decision  can  be  to  buy  several  pieces  of  informa¬ 
tion  simultaneously,  there  will  be  regions  in  the  price  diagram  where 
(Vy  -  Ky  )  equals  (V^  -  )  ,  and  many  sets  of  prices  may  maximize 

K  and  also  meet  the  constraints.  When  buying  simultaneous  information 
yi 

cannot  be  the  best  initial  decision,  a  unique  set  of  price s  that  maximizes 
all  of  the  prices  over  their  corresponding  decision  regions  must  satisfy 


Vv  ‘  Kv  =  0  for  i  =  1 , .  . .  ,n 
yi  yi 

Also,  dK^/dR  must  be  positive  along  the  boundary  where  the  decision 
regions  meet,  at  least  in  the  vicinity  of  the  point  at  which  all  of  the 
prices  are  maximized.  However  a  simple  calculation  will  show  that  this  con¬ 
dition  is  only  met  when  n  equals  two  (see  the  following  discussion).  When 
n  exceeds  two,  dK^/dK^  can  be  negative  along  the  boundary  where  the 
decision  regions  meet,  permitting  the  existence  of  different  sets  of  prices 
which  maximize  the  various  K  over  their  corresponding  decision  regions.) 
When  there  are  only  two  observables,  as  there  were  in  the  examples  in 

Chapters  2  and  3,  there  is  a  unique  pair  of  prices,  (K*  ,K*  )  ,  that  maxi- 

yl  y2 

mizes  the  price  of  each  observable  over  the  corresponding  decision  region, 
provided  that  there  are  no  pairs  of  prices  such  that  the  best  initial  deci¬ 
sion  is  to  buy  both  pieces  of  information  simultaneously.  (An  example  of 
a  decision  problem  where  buying  both  observables  simultaneously  can  be  the 
best  initial  decision  is  "Decision  Problem  One"  in  Chapter  1.  In  such  prob¬ 
lems  it  does  not  matter  which  observable  we  buy  first  because  we  will  always 
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buy  the  other  one.)  In  Fig.  4.5,  the  pair  of  prices  (K^.K*  )  is  repre¬ 
sented  by  the  point  A.  To  see  that  the  coordinates  of  the  point  A  are  the 
maximum  values  that  and  K  can  have  in  their  respective  decision 

regions,  consider  the  boundary  A- B  separating  these  regions.  The  equation 
for  this  boundary  is 


Vv  (K  )  -  K  =  V  (K  )  -  K 

yi  y2  yi  >2  yi  y2 


Differentiating  this  equation  with  respect  to  K 


yl 


yields 


Therefore , 


*>2  (l  +  VV 

'  U  + 


Since  and  dV^/dKy^  must  lie  in  the  interval  [-1,0]  , 

/^K  is  equal  to  the  ratio  of  two  non- negative  numbers.  Thus 
y2  yl 

3Ky2^Kyi  cannot  **  ne8ative  along  the  boundary  A-B  in  Fig.  4.5.  Using 
this  result  and  the  fact  that  the  expected  value  functions  (which  define 
the  other  boundaries  in  Fig.  4.5)  decline  as  the  prices  increase,  we  can 
see  that  the  maximum  values  of  Ky^  and  in  their  respective  deci¬ 

sion  regions  must  be  the  coordinates  of  the  point  A  in  Fig.  4.5.  Thus 
for  sequential  inf trmation  problems  with  two  observables,  we  can  charac¬ 
terize  the  decision  regions  by  finding  or  bounding  the  coordinates  of  a 
single  point  in  the  price  diagram. 

The  coordinates  of  point  A  in  Fig.  4.5  are  given  by  the  solution 


> 
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Figure  4.5.  Price  diagram  showing  maximum  Initial  prices 


a 

i 


r 


of  the  following  pair  of  equations 


\  'W  and  '  WV 


Suppose  we  have  a  pair  of  prices  (K'  ,K'  )  su^h  that 

yi  y2 


K'  <  K*  and  K'  <  K* 

yi“  yi  y2-  y2 


We  define  another  pair  of  prices  as  follows: 


K"  =  V  (K*  )  and  K"  -  V  (K'  ) 

17  17  '  TT  '  tT  VI  '  II  ' 


yl  y2 


y2  y2  yl 


Since  dV 


__  cannot  be  positive,  decreasing  K  from  K*  to 

yi  yj  yj  yj 


K'  cannot  decrease  V  .  Therefore, 

yj  yi 


K*  =  V  (K*  )  <  V  (K'  )  =  K" 
yl  yl  y2  "  yl  y2  y] 


K*  =  V  (K*  )  <  V  (K*  )  =  K" 

y^'  ye 


Thus  if  we  start  with  a  pair  of  prices  such  that  each  is  less  than  or 
equal  to  the  corresponding  coordinate  of  the  point  A  in  Fig.  4.5,  we 
can  find  a  pair  of  prices  that  are  greater  than  or  equal  to  the  coor¬ 
dinates  of  the  point  A.  In  other  words,  if  we  start  with  a  pair  of  lower 
bounds  for  the  maximum  prices  of  the  observables  over  their  decision 
regions,  we  can  find  a  pair  of  upper  bounds  for  these  maximum  prices. 

We  still  are  faced  with  the  problem  of  finding  a  pair  of  prices 
that  are  each  less  than  or  equal  to  the  corresponding  coor¬ 
dinate  of  the  point  A  in  Fig.  4.5.  However,  a  pair  of  prices  that  meets 
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is  less 


N 


prices.  By  repeating  this  procedure  indefinitely,  substituting  each  pair 
of  prices  into  the  decision  tree  in  Fig.  4.1b  to  find  a  new  pair  of 
prices,  we  will  determine  a  sequence  of  price  pairs  that  converge  to 

(K*  ,K*  )  . 

yi  TL 

We  can  show  that  convergence  will  occur  by  using  the  properties  of 
V  that  we  derived  previously.  We  know  that 

yi 


V  (K  ) 

-1  <  V  y2 

K 


<  0 


V  (K  ) 


-1  < 


K 


<  0 


Since  we  have  assumed  that  our  best  initial  decision  cannot  be  to  buy 

both  observables  simultaneously,  and  hence  that  (K*^,K*^)  must  be 

unique,  the  two  functions  V  (.)  and  V  (.)  cannot  both  have  a  slope 

yl  y2 

of  minus  one  in  the  vicinity  of  (K*^,K*^)  .  If  they  did,  the  equations 


K  =  V  (K  )  and  K  =  V  (K  ) 

*»  '  i»  '  \7  \7  V 


yl  y2 


y2  yl 


would  have  a  solution  at  (KJ  +  e  ,  K*  -  e)  as  well  as  at  (K*  ,K*  ) 

yi  y2  ^ 

Thus  in  the  vicinity  of  (K*  ,K*  )  the  following  inequalities  must  be 

yl  y2 

true: 


3v  (K  ) 

yi  y/ 

-1  <  - —  <  0 


Ik 


(K  ) 

yl  y2 

-1  <  — - —  <  0 
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where  we 


have  designated  the  function  whose  slope  strictly  exceeds  minus 


one  as  * 

Since  the  derivatives  of  and  must  satisfy  the  inequali¬ 


ties  above,  we  have 


,,  V V -  W  .. 

-i  <  K*  -  K' 

y2  y2 


Vv  (K*  )  -  Vv  K  > 
y2  yl  y2  yl 


K*  -  K' 


Simplifying  these  inequalities  yields 


K*  -  K'  >  **  -  K*  >  0 

y2  y2  yi  yi " 


K*  -  K'  >  K"  -  K*  >  0 
yl  yl  ”  y2  y2 

Using  the  inequalities  for  the  derivatives  again, 


V  (K"  )  -  Vy  > 

yi  y2  yi  y2 

K"  -  K* 

y2  y2 


yl  y2 


V .  (K"  )  -  V  (K*  ) 


y2  yl 


y2  yi 


K"  -  K* 
yl  yl 


Simplifying  these  inequalities  yields 


K"  -  K*  >  K*  -  K"1  >  0 

y2  y2  yi  yi 


K"  -  K*  >  K*  -  K,rt  >  0 
yl  yl~  y2  y2~ 
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Now  combine  these  with  the  preceding  inequalities: 


K*  - 

K’ 

>  K*  - 

K'" 

2  0 

yl 

yl 

yl 

yl 

K*  - 

K' 

>  K*  - 

K"’ 

>  0 

Y  o 

Yo 

Yo 

Yo 

This  can  also  be  written  as  follows, 


K'  <"  K'"  <  K* 
yl  yl  “  yl 


K'  <"  K"'  <  K* 


Thus  after  two  iterations  we  have  a  pair  of  prices  (K'"  .K'"  )  that 

yi  y2 

must  lie  closer  to  (K*  ,K*  )  than  the  pair  of  prices  with  which  we 

Yl  Y2 

started.  If  we  continue  the  process  we  will  find  other  pairs  of  prices, 
each  of  which  is  closer  to  the  answer  than  the  preceding  pair.  After 
enough  iterations  we  will  be  arbitrarily  close  to  the  maximum  price  of 
eacn  observable  over  its  corresponding  decision  region. 

We  have  been  able  to  find  a  number  of  different  ways  to  approxi¬ 
mate  or  characterize  the  decision  regions.  However,  why  should  we  bother 
to  determine  the  decision  regions,  approximately  or  otherwise?  When  we 
are  faced  with  an  actual  decision  problem  we  will  know  the  prices  of  the 
observables,  or  at  least  we  will  be  able  to  encode  our  uncertainty  about 
the  prices.  (The  next  chapter  deals  with  the  question  of  what  to  do  when 
the  prices  of  the  observables  are  uncertain.)  If  we  know  the  prices  we 
will  only  be  interested  in  that  point  in  the  price  diagram  that  corre¬ 
sponds  to  them.  We  can  determine  our  best  initial  information- purchasing 
decision  by  solving  the  decision  tree  in  Fig.  4.1.  We  cannot  rely  on 
numbers  like  the  values  of  individual  and  simultaneous  information.  We 
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do  not  really  need  to  oetermine  the  decision  regions  for  any  practical 
decision  problem.  However,  we  do  have  to  realize  that  they  exist,  and 
that  the  value  of  sequential  information  depends  on  the  prices  of  the 
observables. 

Utility  and  Risk  Preference 

Up  to  this  point  we  have  assumed  that  our  objective  is  to  maximize 
our  expected  profit.  Now  we  will  show  that  the  conclusions  of  this 
chapter  also  apply  to  a  decision  maker  whose  utility  function  satisfies 
the  delta  property  and  is  monotonically  increasing. 

Introducing  a  utility  function  into  a  sequential  information  deci¬ 
sion  problem  does  not  alter  the  fact  that,  in  general,  V  is  a  func- 

yi 

tion  of  the  prices  of  all  of  the  observables  except  y^  .  This  depen¬ 
dence  can  be  seen  in  the  complete  decision  tree  for  the  problem,  which 
is  shown  in  Fig.  4.6  for  an  arbitrary  utility  function.  V  is  equal 

y± 

to  the  value  of  Ky^  such  that  the  expected  utility  associated  with 
branch  B^,  (the  branch  where  we  first  learn  yt>  is  equal  to  the  ex¬ 
pected  utility  associated  with  branch  BQ  (the  branch  where  we  do  not 

learn  any  of  the  observables) .  Algebraically  V  is  equal  to  the 

yi 

value  of  Kxr  such  that 

U(tvK  ) 

3i.j 

*  racx  x  "-5  U(TT> 

1  n 

for  i  «  i,. .. ,n  . 
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This  relation  holds  for  any  utility  function. 

“hC"  thC  UtI1Ity  functl°n  satl8fl«  delta  property  and  Is  mono- 
tonically  increasing,  we  can  solve  tie  oeuacion  above  for  V 


U  ^(max  E 
c  x 


ft  U(TT)) 


This  equation  can  be  rewritten  in  a  form  that  separates  the  prices  of 
the  observables  from  the  profit  function. 


/ 


V  =  U 

yi 


,-i 


■»«*  |  •••  §  U(TT) 

1  n 


E  max- 

yi 


max  U 

j^i 


..-1  c 

U  E  max 


| "?x  Sj  •  ln  u<">  |\ 

J  (k?i,JUtU"1<?k  Kyi  >J- 


U  (mcx  X  •  •  •  ft  u<rr)) 
1  n 


With  the  equation  for  Vy^  in  this  fora,  we  can  show  that 

9Vyi/3Kya  mUSt  be  ne8ative  or  zero,  and  that  d2Vy  /3Ky  2  must  be 
positive  or  zero.  The  proof  is  similar  to  that  given  previously  for  an 
expected- pro fit  decision  maker,  and  for  this  reason  it  is  only  outlined 
here.  Differentiating  the  equation  above  yields 
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r  max  E  . . .  E  U(rr)  . 

(u’1)’  sk2-  maK  1  .1  " 

yc*  max  U[U  (E  max{ K  ]  ) 

l  y*  y*  J 


10  :  ^  mgx  g  •••  5  2y  U^U  1^y  raax®-' 

1  1  n  1  j 

t —  -  max  U[U  ^(E  max{...})-  K  ]  :  otherwise 

3Ky  j*i  yj  yj 


. })-K  ] 
yj 


Let  j*  be  the  value  of  j  that  maximizes 


/  /  max  E  —  E  U(tt) 

_  „  -1  /  1  C  X1  n 

D  U  U  I  E  max  ( 

yi  y1  . -1,_  , 


i  max  j  ( 

J  (max  U[U"  (E  max K  ]> 
kjH,  j  yk 


and  assume  for  a  moment  that  j*  is  unique.  In  this  case  the  deriva¬ 
tive  becomes 


(U'V  E 


0:  D  max  E  ...  E  U(n)2D  U[U_1(E  max{ ...})-  K  ] 
yi  c  X1  n  yi  yj*  yj* 

rrp-  U[U  *(E  max{...})-  K  ]  :  otherwise 

ya  yj*  yj* 


If  j*  equals  a  , 


i  -1 
-  -  (U  )  '  E 


is  D^max  U(tt)  -  ^U[U_1(E  max{...})-  Ky  ] 


-U'  :  otherwise 


U'  and  (U  )'  are  both  positive  quantities,  regardless  of  their  argu¬ 
ments,  because  the  utility  function  is  monotonically  increasing.  The  ex¬ 
pected  value  of  a  quantity  that  is  everywhere  either  zero  or  negative 
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cannot  be  positive.  Therefore, 


*  0 


dv 

yt 


Wc  can  use  the  sane  argument  that  we  used  before  to  show  that 

/*  cannot  decrease  when  K  Increases,  and  therefore. 


Similarly,  the  same  argument  that  we  used  previously  shows  that  when 

j*  is  not  unique,  or  when  there  are  two  branches  'n  the  decision  tree 

with  the  same  expected  r-ofit.  can  have  a  discontinuous  in- 

crease  and  5  Vy1/SKy(v  can  Contaln  a  positive  impulse.  However,  it  is 
still  true  that 


If  J*  does  not  equal 
and  second  derivatives 


av 


5  0  and 


*  0 


Of 


3K 


a 


a  ,  we  can  get  the  same  conditions  for  the  first 
Of  Vyi  by  extending  the  proof  in  exactly  the 


same  way  that  we  did  before. 


we  have  proven  that  av^/W^  is  less  than  or  equal  to  zero,  and 
It  remains  to  be  shown  that  this  quantity  must  lie  in  the  interval 
[-1.0]  .  We  can  prove  that  a  -l  by  using  implicit  differen¬ 

tiation  when  there  are  only  two  observables,  and  we  can  use  a  qualita¬ 
tive  argument  to  extend  this  result  to  problems  with  more  than  two  ob¬ 


servables . 


When  there  are  only  two  observables  V^(K^  )  is  given  by  the  solu¬ 
tion  of  the  following  equation: 


,-l 


E  max 


(U[u-i(max  E  ...  g  U(tt»  -  V  (K  )] 
J  In  yl  y2 


|u[U_1(E 


max  E  ...  E  U(tt))  -  V  (K  )  -  K  1 


y0  c  x  x 

2  1  n 


yl  y2 


max  E 
c  x. 


E  U(n) 


Differentiating  both  sides  with  respect  to  K  yields 


|u[U_1(max  E^  ...  g  U(TT»  -  V^OCy^)]  j 

I  U[U~ 1  (E  max  g  ...  E  U(n))  -  V  (K  )  -  K  ] 

'  y2  C  X1  Xn  yl  y2  y2  ' 


Thus , 


9K 


3K 


-  U[U  (max  F  ...  ^  U  (T))  -  Vy  (Ky  )  ]  :  Yl  e  cp  j 

r 0 

-  U[U_1(E  mgx  £  ...  §  U( TT) )  -  V  (K  )  -  K  ]  :  y.  t  cp) 

y2  1  n  3  2  3  2  ' 


where 


cp  =  [  yt  :  D  max  g  ...  E  U(tt  -  V  (K  )) 
yl  X1  n  yl  y2 

•••  5nu(n- w  V  1 
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;  yx  e  cp 


1 


U'[U_1(max  E  ...  E  U(tt))  -  V  (K  )] 
c  X1  Xn  yl  y2 


U'[U_1(^  max 


•••  5n  U(n))  -  Vy^Ky^)] 


:  y1  t  cp  , 


Define 

Myl>  *  U'[U_1<max  E^  ...  £  U(tt))  -  Vy^Ky  )]  a  0 
P2(yl)  =  y  U,fU_1<§  mtx  |  •••  g  U(tO)  -  V  (K  )  -  K  1  a  0 

yl  y2  c  X1  n  yl  y2  y2 


a 


1 


^y i )  ^  o 

yxe9 


a 


2 


02(yi)  tyx I  s  o 


Using  these  definitions,  we  have 


Therefore, 


a 


Since  and  cannot  both  be  equal  to  zero,  we  have 


e  [-1,0] 


Similarly,  we  can  show  that 


e  [-1,0] 


This  proof  demonstrates  that  dV  /dK  ^  -  1  when  there  are  only 

yi  yj 

two  observables.  We  will  now  show  that  this  result  must  be  true  for 

any  number  of  observables  when  the  decision  maker's  utility  function  is 

monotonically  increasing.  Assume  that  there  is  a  set  of  prices 

)  ,  such  that  the  decisionmaker's  preference  is  to  buy  yi 

first,  and  SV^/dK^  <  -1  .  In  this  case  we  can  decrease  the  price  of 

y^  from  to  (K^  -  e)  ,  and  the  decision  maker  will  increase  the 

amount  he  is  willing  to  pay  for  y,  from  V  (K°  . K°  )  to 

o  o  ^i  ^1  ^n 

[Vv,  (KV  *-"’Kv  )  ^  >  where  6  >  e  .  If  the  prices  of  the  observables 

”  *1  yn 

are  (K  , . . . ,K  )  ,  a  broker  could  make  money  by  buying  y,  for  K° 

*1  yn  i  yi 

and  offering  to  sell  the  observables  to  the  decision  maker  for 

(Ky  , . . . ,K  +  6,...,K  -  €,..., K  )  .  The  decision  maker  would  be  will- 

1  1  yn 

ing  to  buy  yt  first  for  (K°  +  6)  ,  giving  the  broker  a  profit  of  6  . 

The  broker  would  still  be  obligated  to  buy  any  additional  observables  at 
the  original  prices  and  sell  them  to  the  decision  maker.  However,  the 
broker  would  lose  at  most  e  by  doing  so.  Thus  he  would  make  a  profit 
of  at  least  (6  -  e)  . 

A  decision  maker  who  finds  himself  in  this  situation  can  increase 
his  assets,  and  hence  his  expected  utility,  by  acting  as  his  own  broker. 
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Thus,  whenever  the  prices  of  the  observables  are  (K°  . K°  )  he  is 

o  yl  ^n 

willing  to  pay  [Vy  (Ky^,...,Ky  )  +  6]  to  learn  first.  However, 

this  contradicts  the  fact  that  Vy^  is  the  maximum  amount  the  decision 

maker  will  pay  for  y  .  Since  our  assumption  that  /9K  <  -1 

yi  yj 

has  led  to  a  contradiction,  it  cannot  be  valid. 

Combining  this  result  with  the  proof  that  3V  /5K  £  0  ,  we  have 

yi  yj 

avy 

SiT  e  t-1.0] 

yJ 

whenever  the  decision  maker's  utility  function  satisfies  the  delta 
property  and  is  monotonically  increasing. 

It  is  clear  that  V  must  exceed  V**  and  V*  ,  regardless  of 

i  j^i  y  ^ 

the  form  of  the  decision  maker's  utility  function.  The  utility  func¬ 
tion  does  not  alter  the  fact  that  we  can  achieve  the  expected  utility 
associated  with  individual  or  simultaneous  information  by  making  the 
proper  set  of  sequential  decisions.  Thus  we  must  be  willing  to  pay  at 
least  as  much  for  sequential  information  about  an  observable  as  we  would 
for  individual  or  simultaneous  information.  (The  amount  we  would  pay 
for  simultaneous  information  is  the  residual  value  of  the  information.) 

It  is  also  easy  to  see  that  introducing  a  utility  function  does  not 
alter  the  number  of  subordinate  decision  problems  that  we  must  solve  to 
find  the  value  functions  and  the  decision  regions.  However,  it  may  be 
considerably  more  difficult  to  solve  each  subordinate  decision  problem 
when  we  have  to  take  into  account  the  decision  maker's  utility  function, 
especially  if  his  utility  function  does  not  satisfy  the  delta  property. 
Regardlesr  of  the  form  of  the  decision  maker's  utility  function,  we 


132 


can  use  decision  tree  in  Fig.  4.6  to  determine  V  and  the  best 

y± 

initial  information- purchasing  decision  for  any  given  set  of  prices, 

(Kyi » •  •  •  »Kyn)  •  the  utility  function  does  not  satisfy  the  delta 
property,  solving  for  the  value  of  that  equalizes  the  expected 

utilities  associated  with  branches  and  BQ  in  Fig.  4.6  will  re¬ 

quire  a  number  of  trial-and-error  calculations.  However  this  is  unneces¬ 
sary  if  th*  delta  property  applies.  By  solving  the  decision  tree  with 
a  number  of  different  sets  of  prices,  we  can  determine  the  approximate 
boundaries  of  the  decision  regions  in  the  price  diagram. 

When  the  decision  maker's  utility  function  satisfies  the  delta 
property  and  is  monotonically  increasing,  we  can  use  the  fact  that 
SVy^/SKy  cannot  be  positive  to  show  that 


V  (K  , .  .  .  ,K  )  s/ 

”  "  yn  yl-*-yn 


*  v»» 

yi  yl 


yi 


Thus  we  can  use  the  value  of  learning  all  of  the  observables  simul¬ 
taneously  as  an  upper  bound  for  the  maximum  value  of  learning  se¬ 
quentially.  However,  is  still  a  weak  upper  bound  for  V 

yl * ’ ’yn 

over  its  associated  decision  region. 

When  there  are  only  two  observables,  we  can  use  the  argument  pre¬ 
sented  earlier  to  show  that  the  maximum  value  of  V  over  its  associ- 

N  Yi 

ated  decision  region  is  bounded  by  V  (V  )  since 

yi  yj 


* 


e  t-1.0]  ti,j  =  1,2/ 


Thus  we  are  able  to  extend  the  results  of  this  chapter  to  the  case 
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where  the  decision  maker's  utility  function  satisfies  the  delta  proper¬ 
ty  and  is  monotonically  increasing. 


Summary 


In  this  chapter  we  have  proven  the  following  statements: 

1.  The  value  of  sequential  information  is  a  function  of  the 

prices  of  the  observables. 

N  R 

2.  V  ^  V  and  V  ^  V  for  any  set  of  prices  (K  , .  .  .K  ) . 

yi  yi  yi  yi  yi  yn 

3.  V  exceeds  both  and  whenever  learning  y,  can 

yi  yi  yt  B  * 

affect  our  decision  to  buy  another  observable. 

4.  dV  /dK  e  [-1,0]  when  the  decision  maker's  utility  function 

yi  yj 

is  monotonically  increasing  and  satisfies  the  delta  property. 

5.  /9K  ^  0  when  the  decision  maker's  utility  function  is 

yi  yj 

monotonically  increasing  and  satisfies  the  delta  property. 

6.  If  there  are  n  observables,  we  must  solve  ( 2°- 1 )  subordinate 

decision  problems  to  determine  the  value  functions  and 

the  decision  regions. 

N 

7.  y  is  an  upper  bound  for  the  value  of  sequential  in¬ 
formation. 


8.  When  there  are  only  two  observables,  V  is  bounded  by 

yi 

V  (K  )  for  all  pairs  of  prices  where  our  best  initial  deci- 

yi  yj 

sion  is  to  buy  y^  .  This  holds  when  the  decision  maker's 
utility  function  is  monotonically  increasing  and  satisfies  the 
delta  property. 


CHAPTER  5 


SEQUENTIAL  INFORMATION  WITH  UNCERTAIN  AND  NON-ADDITIVE  PRICES 

In  this  chapter  we  extend  the  results  of  the  previous  chapters  to 
include  problems  where  the  cost  of  information  is  either  uncertain  or 
not  additive.  The  two  types  of  pr ices--uncer tain  and  not  additive-- 
are  considered  separately.  However  we  shall  see  that  under  certain  con¬ 
ditions  both  cases  can  be  analyzed  using  simple  modifications  of  the 
procedures  developed  previously.  We  use  the  same  notation  in  this  chap¬ 
ter  that  we  used  before.  Utility  and  risk  aversion  are  not  considered 
in  this  chapter. 

The  analysis  of  sequential  information  problems  with  uncertain  and 
non-additive  prices  is  first  illustrated  by  considering  simple  modifica¬ 
tions  of  the  bidding  problem  introduced  in  Chapter  2.  Then  the  results 
are  generalized  to  apply  to  all  decision  problems. 

The  Bidding  Problem  with  Uncertain  Prices 

Suppose  that  we  face  the  bidding  decision  described  in  Chapter  2, 

but  we  are  uncertain  about  the  cost  of  learning  our  production  cost  p 

or  the  lowest  competing  bid  l  .  Thus,  in  addition  to  the  probability 

density  functions  that  describe  our  state  of  information  about  p  and 

l  ,  we  also  have  probability  density  functions  for  the  prices  K  and 

P 

.  Assume  for  a  moment  that  we  have  assessed  p  ,  l  ,  k  ,  and  K  to 

P  & 

all  be  independent  random  variables.  (We  will  relax  this  assumption 
later  in  this  chapter.)  Thus 

£p,*,Kp,Kt|&}  =  {P|s3  U|s}  {Kp|&}  {Kj5} 
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As  in  Chapter  2,  we  assume  that  {p|&}  is  a  uniform  distribution  be¬ 
tween  zero  and  one,  and  that  { X| S }  is  a  uniform  distribution  between 
zero  and  two.  These  distributions  are  shown  in  Fig.  2.1.  We  shall  al¬ 
low  {k  and  {K Jfe}  to  be  arbitrary  probability  density  functions. 

P  * 

If  we  do  not  receive  any  information  about  p  and  X  our  expected 


profit  i 


mgx  E  ^  TT(p ,  X,b)  =  max  E 


:  b  <  JL^ 


0  :  b  a  X 


=  27/96 


If  we  pay  for  perfect  information  about  p  ,  and  do  not  intend  to 

learn  X  ,  then  our  expected  profit  after  learning  p  is 


max  E  rr(p,X,b)  -  K 
b  X  P 


Before  we  know  p  and  our  expected  profit  is 


P  Kp  ^ 


E  max  E  rr(p,X,b)  -  E  Kp 

n  D  Xj 

=  E  max  E  TT(p,X,b)  -  K 
P  b  i  P 


We  define  K  as  follows 
P 


K  -  E  K  =  <K  !&> 
P  Kp  P  P1 


Therefore  we  should  pay  Kp  to  learn  p  by  itself  when 

Kp  <  =  (E  mgx  -  mjix  E  I|)  rr(p,X,b)  =  1/96 

Using  exactly  the  same  reasoning  we  find  that  we  should  pay  K^  to 
learn  X  by  itself  when 

<  ^  =  ^  m§x  f  "  m§x  p  u(p,X,b)  =  27/96 
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If  we  pay  Kp  plus  to  learn  p  and  l  simultaneously,  our 

expected  profit  after  learning  both  state  variables  is 

mgx  TT(p,X,b)  -  Kp  -  Kj 

(At  this  point  we  are  still  assuming  that  rrices  are  additive.  The 
case  of  non-additive  prices  will  be  considered  later  in  this  chapter.) 
Before  we  know  the  state  variables  or  their  prices,  our  expected  profit 
is 


HipS,  'v  -  v  Ki] 

■  1 $  t  n(p-iib)  -  Kp  - 

Therefore  we  should  pay  to  learn  p  and  t  simultaneously  when 

%  +  <  'p r  (p  5  T  ‘  "bx  p  V  TT(p,x,b)  =  29/96 

Now  consider  the  problem  of  buying  the  two  pieces  of  information 
sequentially.  Suppose  we  have  already  peiu  Kp  to  learn  p  .  At  the 
same  time  that  we  learned  p  ,  we  Uso  found  out  how  much  the  informa¬ 
tion  cost.  Next  we  must  decide  whether  or  not  to  pay  K.  for  l  If 

we  decide  not  to  pay  for  l  ,  our  expected  profit  as  a  function  of  p 

and  K  is 

P 

mg*  ^  TT(p,*,b)  .  Kp 

If  we  decide  to  pay  for  L  ,  our  expected  j  ofit  as  a  function  of  p 

and  K  is 

P 

5  |  fn¥c  n<P»^b)  -  Kp  -  Kx]  *  E  max  ■T'p.X.b)  -  Kp  - 
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We  should  pay  for  l  when 


<  (I|  mgx  -  mgx  ££)  n(p,£,b)  =  (1  -  p/2)  /2 


This  is  the  same  decision  rule  that  we  found  for  the  case  of  certain 
prices,  except  now  is  replaced  by  .  Carrying  out  the  same 

calculations  that  we  did  in  Chapter  2  we  find  that  our  expected  profit 


after  learning  p  and  is 


max' 


{E  max  TT(p,£,b)  - 

max  E  TT(p,  £,b) 
b  l 


-  K_ 


Before  we  know  p  and  our  expected  profit  is 


E  E 


max" 


E  max  TT(p,  £,b)  - 
l  b 


[max  E  TT(p,£,b) 


>-  K 


5- 


E  max  n(p,  £,b)  - 


l  b 

max<  Y  -  K 


max  E  n(p,£,b) 
v  b  l 


Thus  we  should  pay  Kn  to  learn  p  ,  with  an  option  to  pay  for 


l  ,  when 


Kp  <  Vp(I9  =  E  maX< 


rE  max  TT(p ,  £,b) 

l  b 


[mgx  I|  TT(p,£,b) 


-  max  E  E  n(p,£,b) 
b  p  i 


29/96  -  K£  :  K£  £  1/8 
33/96  +  (/A  3)K£V^~ 
1/96  :  1/2  ^  K£ 


2K^  :  1/8  <  <  1/2 
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We  can  use  the  same  reasoning  to  show  that  we  should  pay  to  learn 


l  ,  with  an  option  to  pay  Kp  for  p  ,  whenever 


Ki 4  vi(V  ■  5 


{E  mgx  TT(p,  i,b)  - 
max  E  TT(p,£,b) 


mgx  E  1|  TT(p,£,b) 


29/96  +  (2/3)15  >/iR~  -  Kp/2  :  Kp  <  1/8 


27/96  :  K  ^  1/8 

P 


These  decision  rules  for  buying  perfect  information  about  p  and 
l  are  the  same  as  the  ones  we  found  in  Chapter  2  for  certain  prices, 
except  this  time  Kp  and  K£  are  replaced  by  their  expected  values. 
Therefore,  regardless  of  the  probability  density  functions  for  Kp  and 
K.  ,  we  can  base  our  decisions  on  K  and  K.  as  long  as  all  the  random 

Xt  r  * 

variables  are  independent.  In  fact  we  can  draw  a  price  diagram  similar 
to  the  one  in  Chapter  2  with  Kp  and  measured  along  the  axes. 

This  is  shown  in  Fig.  5.1.  The  decision  regions  in  Fig.  5.1  show  us 
what  to  do  for  any  pair  of  expected  prices,  (Kp,K^)  . 

Now  we  will  relax  the  assumption  that  Kp  and  are  independent. 

Assume  that  p  and  l  are  still  independent  of  each  other  and  the 
prices,  but  that  Kp  and  are  dependent.  Thus 


{p,Jt,Kp,Kje|S}  =  {p|«}  U|4}  {Kp.Kjfc} 


The  probability  density  function*-  for  p  and  l  arc  the  same  as  before, 
and  {Kp.Kjfi}  is  arbitrary. 

Using  the  same  logic  that  we  did  in  the  case  where  Kp  and 
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were  independent,  we  find  that  we  should  pay  Kp  to  learn  p  by  itself 


K  <  V*1  =  (E  max  E  -  max  E  E)  TT(p,£,b)  =  1/96 

P  P  P  b  £  b  P  £ 

Similarly  we  should  pay  to  learn  £  by  itself  when 

K.  <  V1!  =  (E  max  E  -  max  E  E)  rr(p,£,b)  =  27/96 

1  L  £  b  P  b  P  £ 

We  should  pay  K  plus  K.  to  learn  both  state  variables  when 
p  £ 

K  +  K,  </,  «  (E  E  max  -  max  E  E)  rr(p,£,b)  =  29/96 
P  1  P*  P£b  bP£ 

So  far  the  fact  that  Kp  and  K^  are  dependent  has  not  changed 

the  decision  rules.  However  when  we  consider  sequential  information 

the  decision  rules  are  different.  Suppose  we  have  already  paid  Kp  to 

learn  p  ,  and  we  are  trying  to  decide  whether  or  not  to  pay  K^  for 

£  .  If  we  decide  not  to  pay  for  £  ,  our  expected  profit  as  a  function 

of  p  and  K  is 
P 

max  E  nCp.i.b)  -  K 
b  /  P 

If  we  decide  to  pay  for  £  ,  our  expected  profit  is 

DEE  [max  TT(p,£,b)  -  K  -  K  ]  -  E  max  TT(p,£,b)  -  K  -  D  EK. 
KpXK^  P  £  £  b  P  KpK^ 

We  should  pay  for  £  whenever 


D  E  K  .<  (E  max  -  max  E  )  rr(p ,  £,1 
K_  *  £  b  b  £ 


This  is  not  the  same  decision  rule  that  we  found  previously.  The  left 

side  of  this  inequality  is  a  function  of  K  ,  and  is  not  equal  to  K. 

P  £ 


A 


The  quantity  D  E  K.  is  determined  by  the  dependency  of  K.  on  K  , 

Kp  1  1  p 

or,  in  other  words,  it  is  determined  by  [k  ,K.|feJ  .  Since  there  is  no 

P  * 

way  to  describe  allof  the  possible  dependencies  between  and  — 

or  all  of  the  possible  joint  probability  density  functions  for  and 

K ^  —  by  a  single  number,  it  is  impossible  to  represent  p  E  as  a 

_  _  P  * 

single  point  in  the  K  -K.  diagram. 

P  * 

Continuing  the  calculations  as  before,  we  find  that  our  expected 


profit  after  learning  p  and  is 


ftT-  n(p'1'b) '  Rpi/i’l 


max 


{max  E  rr(p, i,,b) 
vb  l 


J 


E  mjix  TT(p,  £,b) 


m^x  E  n(p,  £,b) 


E  K . 

K.  t 


-  K_ 


Before  we  know  p  and  Kp  our  expected  profit  is 


J 


E  E  max« 

P  Ro 

max  E  TT(p,i,b) 
v  b  i 


K 


Thus  we  should  pay  K  to  learn  p  ,  with  an  option  to  pay  K.  for  j l  , 

P 

whenever 


K  <  E  E  max" 
P  P  Kp 


IT  •  6/* 


JMX  E  TT(p,i,b) 
b  l 


E  E  max  rr(p ,  £,  b) 
P  l  b 


'29/96  -  K.  :  D  E  K.  *  1/8 
1  1 


E  [33/96  +  (4/3) (E  Kjy2(fe  Kp  -  2(E  K£)J  :  1/8  <  D  E  K,  < 

kp  K£  Kp  Kjg  * 


1/2- 


.1/96  :  1/2  s  D  E  K„ 

Kp  K£  1 
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Similarly  we  can  show  that  we  should  pay  to  learn  L  ,  with  an 


option  to  pay  for  p  ,  whenever 


K  .  <  E  E  max- 
1  i  K  o 


"E  mgx  TT(p,£,b)  -  E^  Kp 
[mgx  E  TT(p,£,b) 


p  \  m§X  n(P»  £»b> 


f E  [29/96  +  (4/3) (E  K  )  /2(E  K  )  -  2(E  K  ) ]  : D  E  K  <  l/s| 

Ki  Kp  p  h  p  Kp  P  KiVp  P  1 


27/96  :  D  E  K  ^  1/8 

K*Kp  p 


Obviously  the  analysis  developed  in  the  previous  chapters  breaks 
down  when  and  are  dependent.  It  is  no  longer  possible  to  de¬ 
fine  decision  regions  in  the  space,  or  define  the  value  of  se¬ 

quential  information  as  a  function  of  the  expected  prices.  We  could 
define  the  value  of  sequential  information  in  terms  of  the  joint  prob¬ 
ability  density  function  for  K  and  K. 

P  t 

VP  ■  V'y**1*1* 

However  this  sort  of  function  is  not  very  useful.  Since  the  dependen¬ 
cies  between  and  ,  as  given  by  the  joint  probability  density 

function,  cannot  be  represented  by  a  finite  set  of  numbers,  it  is  impos¬ 
sible  to  describe  decision  regions  in  any  finite- dimensional  Euclidean 
space.  However,  for  any  given  Joint  probability  density  function, 
(Kp.igs)  ,  we  can  solve  the  equations  above  to  find  the  best  way  to 
purchase  information  sequentially. 
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General  Formulation  of  Sequential  Information  Problems  with  Uncertain 


Prices 

In  a  general  decision  problem  with  sequential  information  and  un¬ 
certain  prices,  we  have  a  profit  tt  that  depends  on  a  control  variable 
c  and  a  set  of  state  variables  (x^,...,xm)  .  We  have  an  opportunity 

to  learn  any  of  a  set  of  observables  (y^»...»yn)  for  prices  (Ky . 

Kj,  )  ,  respectively.  The  state  variables,  observables,  and  prices  are 
all  random  variables,  and  our  state  of  information  about  these  random 
variables  is  given  by  our  assessment  of  the  joint  probability  density 
function 


txl’---’Vyl . VKy  ,’---’KyJS} 


yi  yn 

When  we  commit  ourselves  to  paying  for  the  i^  observable,  we  learn  the 

actual  value  of  both  y.  and  K  .  Then  we  pay  K  for  the  informa- 

1  yi  Yi 

tion.  The  complete  decision  tree  for  an  expected- value  decision  maker 
is  shown  in  Fig.  5.2. 

The  expected  value  of  learning  y^  sequentially,  when  we  are  try¬ 
ing  to  maximize  expected  profit,  and  when  the  cost  of  information  is 
uncertain,  is 


f  max  E  .  .  .  E  tt(x,  , .  .  .  ,x  ,c) 
c  xi  xm  ! 


E  E  max 

yi  \ 


f  5  f 

max 

max  E  ... 
c  xi 

E 

Xm 

n(xl . VC> 

-  K 

V^j 

[...]) 

yj 

-  max  j 


E  n(x. , . . . ,x  ,c) 
x  1  m 
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5.2b.  Sequential  information  decision  tree  with  uncertain  prices  (continued) 


E  E  ' 
yiKyi 


T  lt  ••  \  n(xi . Vc)  :  ?1gyim?x  im 

n(xi . vc) 

^  (E  E^  [max{ . . . }  -  Ky^])  :  otherwise 


The  question  of  whether  or  not  the  following  inequality  holds 

^  $  m£X  5  ^*1* '  • '  ,Xm,c^ 


^  D  D  max  (E  E  [max{. 
yi  Ky1  J?i  yj  *yj 


}  "  Ky  ]) 

yj 


depends  on  D  D  E  K  rather  than  on  K  .If  K  is  indepen- 

yt\*y.  yj  yj  yJ  - 

dent  of  y.  and  1C,  J,  then  DDE  K  is  the  same  as  K  and 
1  ^i  Vi  Kyi  Yyi  Yj  Yj 

the  decision  rule  depends  on  Ky^  .  However,  if  Ky^  is  not  indepen¬ 
dent  of  y,  and  K  ,  the  decision  rule  will  depend  on  D  D  E  K  , 

i  yi  Xi  Ky  *y  yj 

which  requires  a  knowledge  of  the  entire  joint  probability  density  func¬ 
tion  rather  than  Just  the  expected  values  of  the  prices.  Therefore  we 
can  determine  the  value  of  sequential  information  and  the  decision  re¬ 
gions  in  terms  of  the  expected  values  of  the  prices  whenever  Ky^  is 

independent  of  y,  and  K  ,  for  all  J  ■  l,...,n  and  for  all  i  not 
1  yi 

equal  to  j  .  When  the  prices  are  not  independent--or  when  an  observ¬ 
able  is  not  independent  of  the  price  of  another  observable-- the  analysis 
breaks  down  However  we  can  still  solve  the  problem  using  the  decision 
tree  in  Fig.  5.2  if  the  joint  probability  density  function  for  all  the 
random  variables  is  known. 
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The  Bidding  Problem  with  Non-Additive  Prices 


Now  we  can  turn  our  attention  to  the  case  where  the  prices  are 
certain  but  they  are  not  additive.  This  means  that  the  cost  of  learn¬ 
ing  two  or  more  of  the  observables  need  not  equal  the  sum  of  the  costs 
of  learning  each  individually.  For  example,  in  the  bidding  problem  Kp 
is  the  co£ t  of  learning  p  ,  and  is  the  cost  of  learning  £  .  We 

assumed  that  the  total  cost  of  learning  both  p  and  £  ,  either  simul¬ 
taneously  or  sequentially,  was  K  plus  K .  .  We  are  now  going  to  re- 
lax  that  assumption  and  define  the  following  prices: 

K  =  cost  of  learning  p  and  £  simultaneously 

r  ** 

Kpj^=  cost  of  learning  p  sequentially  after  we  already  know  £ 

K£|p  =  cost  learning  £  sequentially  after  we  already  know  p  . 

Any  time  we  change  the  pricing  structure,  we  must  change  the  deci¬ 
sion  rules  for  buying  information  because  the  rules  are  described  in 
terms  of  the  prices.  For  the  bidding  problem  with  non-additive  prices, 

the  decision  rules  depend  on  all  five  prices  (K  ,K.,K  .,K  ■  and  K,i 

P  V  p£  p|  £’  £|p 

rather  than  on  just  Kp  and  .  Thus  the  price  diagram  for  this 
problem  will  have  five  dimensions,  with  one  of  the  prices  measured  along 
each  axis.  Although  it  is  difficult  to  visualize  decision  regions  in 
five  dimensions,  the  regions  are  fairly  easy  to  describe  algebraically, 
and  we  can  determine  them  with  the  procedures  used  in  the  previous  chap¬ 
ters  . 

If  we  do  not  receive  any  information  about  p  or  £  ,  our  expected 
profit  is  still 

max  E  E  TT(p,£,b)  «  27/96 
b  P  £ 


The  reasoning  we  used  before  shows  that  we  should  pay  Kp  for  p  by 


Itself  when 


Kp  <  vj  -  (E  mgx  -  mgx  E  Ip  n(p,f,b)  *  1/96 

Similarly,  we  should  pay  for  i  by  itself  when 

K .  <  V*!  *  (E  max  E  -  max  E  E)  TT(p,i,b)  =  27/96 
1  1  ibp  bpf 

If  we  pay  to  learn  p  and  l  simultaneously,  our  expected 

profit  before  receiving  the  information  is 


E  E  max  n(p,jt,b)  -  K 
P  l  b  Pi 


Thus  we  should  pay  to  learn  p  and  i  simultaneously  whenever 

*  (E  1|  mgx  -  mgx  E  Ip  rr(p,£,b)  -  29/96 


If  we  do  not  have  the  option  of  learning  the  state  variables  se¬ 
quentially,  the  price  diagram  would  have  three  dimensions  correspond¬ 
ing  to  K  ,  K.  ,  and  K  ,  .  Our  best  decision  is  to  pay  K  for  p 

P  X  p  Jt  p 


V1*  -  K  >0 
P  ? 

VN  -  K  >  V*J  -  K 
p  p  l  l 

vj  -  K  >  v“ .  -  K  , 
p  p  pi  pi 

Similar  inequalities  describe  the  sets  of  prices  (K  ,K.,K  .)  where 

p  l  p  l 

our  best  initial  decision  is  to  buy  i  ,  or  to  buy  both  state  variables 
simultaneously.  These  decision  regions  are  shown  in  Fig.  5.3. 


0  ■  ■  buy  both  p  and  i 

(Drawn  attuning  >  v£  ;  not  drawn  to  tcale) 

Figure  5.3.  Dtcition  region!  for  individual  and  tlnultaneout  information 
whan  prleet  are  not  addltlva. 


Now  consider  the  possibility  of  sequential  information.  Suppose 
we  have  already  paid  to  learn  p  ,  and  we  are  trying  to  decide 

whether  or  not  to  pay  ^£|p  to  learn  I  •  If  we  decide  not  to  learn 
l  ,  our  expected  profit  is 


m§X  £  TT^P»i»b)  '  Kp 

If  we  decide  to  pay  for  i  ,  our  expected  profit  before  receiving  the 
information  is 


E  max  TT(p ,  £,b)  -  K  -  K., 

I  b  p  !|p 


Since  we  will  choose  the  larger  of  these  two  quantities,  our  expected 
profit  prior  to  learning  p  is 


E  max-« 
P 


it  -  Ki|PI 


[max  E  TT(p,£,b) 


-  K 


Thus  we  should  pay  K  to  learn  p  ,  with  an  option  to  pay  Kai  for 

F  £|p 


l  ,  whenever 


(W  E  TT(p.<.b)  -  Ki|p, 


Kp  <  Vp(K£|.  >  *  ?  max 


J’ 

IP] 

|E  max  tt(p  ,  £,b) 


mgx  E  E  rr(p ,  £,b) 


^9/?6  ’  Ki|P  =  Ki|p  5  l's 
33/96  +  <«/3)Kje|p^--  2Kj(|p  : 

ll/96  :  1/2  s  Kjt|p 


1/8  <  Kejp  <  1/2| 


This  is  the  same  function  that  we  derived  in  Chapter  2,  except  that  K 


\ 
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has  been  replaced  by  K^| 

The  same  reasoning  shows  that  we  should  pay  K.  to  learn  SL  with 

Sj  * 

an  option  to  pay  Kp | ^  for  p  ,  whenever 


1  mr  -  kp  \t 


max* 


-  max 


ijjx  g  \  ^(p.je.b) 


P  nCp,  je,b) 


1  Su<‘« 


27/96  :  K  i  ,  £  1/8 

pU 


j 


In  order  to  maximize  our  expected  profit  we  should  pav  K  to 

P 


learn  p  ,  with  an  option  to  pay  K£|p  for  l  ,  whenever 

vp(kjs|p)  -  KP  >  0 


vp(k«!p)  -  KP  »  v“  • 

VKV  -  KP > •  V 

Vp<%)-kp>VkpU>-'', 

(It  is  not  necessary  to  add  the  condition 

V  <K,,)  -  K  >  ^  -  K 
P  X|p  P  P  P 

since  we  can  show  that  V^K^)  >  vjj  for  any  value  of  .)  Sim¬ 

ilar  inequalities  describe  the  set  of  prices  (K  ,K.,K  ..K  ,  ,K  .  ) 

p  i  pr  P | x* 

such  that  our  best  initial  decision  is  to  buy  l  with  an  option  to  buy 
P  ,  to  buy  either  state  variable  individually,  or  to  buy  both 
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simultaneously.  We  will  not  attempt  to  visualize  the  five-dimensional 
price  diagram. 

Unless  we  have  some  method  of  restricting  the  five  prices  so  that 
they  can  be  described  with  less  than  five  numbers,  we  are  forced  to  con¬ 
sider  decision  regions  <n  spaces  with  five  dimensions.  One  way  to  re¬ 
strict  the  prices  is  to  assume  that  they  are  additive.  Another  way, 
which  allows  us  to  reduce  the  cost  of  one  observable  if  we  have  already 

learned  another,  is  to  assume  that  there  are  reduction  factors  \  and 

P 

such  that  the  cost  of  learning  l  is  when  we  have  already 

paid  K  to  learn  p  .  Similarly,  the  cost  of  learning  p  is  X  K 
P  p  p 

when  we  have  already  paid  for  l  .  Normally  Xp  and  will 

both  lie  between  zero  and  one  ,  but  we  allow  them  to  have  any  positive 
values.  When  and  X^  both  equal  one,  we  have  the  case  of  addi¬ 

tive  prices. 

Consider  the  bidding  problem  for  arbitrary  X  and  X.  .  The  rea- 

P  * 

soning  we  used  previously  shows  that  we  should  pay  Kp  to  learn  p  by 
itself  when 

Kp  <  vp  *  (p  “g*  \  '  mgx  p  5  TT(P»je»b>  ■  1/96 

Similarly  we  should  pay  to  learn  l  by  itself  when 

-  (E ;  max  E  -  max  E  E)  TT(p,£,b)  -  27/96 
JL  d  P  b  P  X 

If  we  decide  to  learn  p  and  £  simultaneously,  we  have  a  choice 

of  paying  (Kp  +  X £  or  (K^  +  XpKp)  •  The  first  price  coriesponds 
to  first  learning  p  and  then  £  .  The  second  price  corresponds  to 


first  learning  £  and  then  p  .  We  get  the  same  information  either 
way  since  we  will  receive  both  pieces  of  information  simultaneously. 
Assuming  that  we  pay  the  lower  of  the  two  prices,  our  expected  profit 
after  deciding  to  pay  for  p  and  £  ,  but  before  we  receive  the  in¬ 
formation,  is 


Thus  we  should  pay  to  learn  p  and  £  simultaneously  whenever 


(E  ]|  m^x  -  mgx  E  E)  rr(p,£,b) 


The  decision  rules  for  individual  and  simultaneous  information 
about  p  and  £  are  shown  in  Fig.  5.4.  The  regions  where  we  will  buy 
perfect  information  about  p  or  £  individually  are  the  sets  of  price 
pairs  represented  by  points  below  the  line  A-B  and  to  the  left  of  the 
line  C-D,  respectively.  These  are  the  same  as  the  sets  of  price  pairs  that 
we  found  in  Chapter  2  for  additive  prices.  (See  Fig.  2.2.)  However  we 
are  now  willing  to  learn  p  and  £  simultaneously  for  any  pair  of 
prices  represented  by  a  point  below  or  the  the  left  of  the  boundary 
G-I-H.  When  the  prices  are  additive,  a  single  45°  line  bounds  the 
pairs  of  prices  such  that  we  will  pay  to  learn  p  and  £  simultaneously. 
In  Fig.  5.4  the  45°  line  splits  into  two  lines,  E-H  and  G-F.  We  are 
willing  to  pay  any  pair  of  prices,  with  the  appropriate  reductions, 
represented  by  a  point  below  or  to  the  left  of  either  line. 


V 
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Now  consider  the  case  of  sequential  information  when  the  prices 

are  altered  by  the  reduction  factors,  X  and  .  Suppose  we  have 

P  * 

already  paid  Kp  to  learn  p  ,  and  we  are  trying  to  decide  whether  or 
not  to  pay  to  learn  l  .  If  we  decide  not  to  learn  i  ,  our  ex¬ 

pected  profit  is 

mgx  ^  TT(p,jfc,b)  -  Kp 

If  we  decide  to  pay  for  i  ,  our  expected  profit  prior  to  receiving 
the  information  is 


E  mgx  TT(p,jt,b)  "  Kp  -  X^ 


Since  we  will  choose  the  larger  of  these  two  quantities,  our  expected 
profit  prior  to  learning  p  is 


Enax  TT(p,Jfc,b)  -  X^ 


E  max- 
P 


max  E  TT(p,  jt,b) 
b  j l 


-  K 


Thus  we  should  pay  Kp  to  learn  p  ,  with  an  option  to  pay  X^C^  for 
j i  ,  when 


kp  <  V  W 


E  max* 
P 


"max  E  Tr(p,  A,b) 
b  j l 


E  max  TT(p,  i,b) 
.1  b 


-  max  E  E  TT(p,jf,b) 
b  P  l 


{29/96  -  :  Kx  £  1/(8XX) 

33/96  +  <V3)X^V2X/£  -  :  1/<8XX>  <  <  1/(2XX)| 

1/96  :  1/(2XX)  *  K£ 
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Similarly,  we  should  pay  to  learn  l  ,  with  an  option  to  pay  X^K 

for  p  ,  when 


K.<V.(U) 

l  1  p  p7 


E  ma> 

1 


'E  mgx  TT(p,f,b) 


max  E  TT(p,jl,b) 

b  P 


X  K 
P  P 


-  mgx  E  E  TT(p,jt,b) 


29/96  +  (2/3)^^^-  -  yp/2  :  Kp  <  l/(8Xp) 


27/96  :  Kp  2  1/<8XJ 


These  decision  rules  are  shown  graphically  in  Fig.  5.5.  The  effect 
is  to  stretch  the  boundary  for  additive  prices  (dashed 

curve  A-B'-H'-C-D  in  Fig.  5.5)  to  the  right  by  a  factor  of  (1/X.)  . 

At 

Similarly,  the  effect  of  Xp  is  to  stretch  the  boundary  for  addi¬ 

tive  prices  (dashed  curve  E-H'-F'-G  in  Fig.  5.5)  up  hy  a  factor  of 
(1/Xp)  •  Thus  it  is  possible  to  visualize  the  decision  regions  in  a 
two-dimensional  space,  where  and  X^  ate  used  to  stretch  the  deci¬ 

sion  boundaries  for  the  corresponding  problem  with  additive  prices. 


General  Formulation  of  Sequential-Information  Problems  with 
Non-Additive  Prices 

As  before,  the  general  problem  with  sequential  information  is 
characterized  by  a  profit  function  tt  that  depends  on  a  control  varia¬ 
ble  c  and  a  set  of  state  variables  (x.,...,x  )  .  This  time  the  ob- 

i  m 

servables  (y^,...,yn)  have  certain  prices,  but  the  prices  depend  on 
the  order  in  which  the  observables  are  purchased.  We  can  define  all  of 
the  possible  prices  as  follows: 


Figure  5.5.  Price  diagram  for  sequential  information  with  reduced  prices 


Ky  =  cost  of  learning  when  none  of  the  other  observables 

are  known; 

Ky i I y  E  COSt  learn*n6  yt  when  is  known; 

K  |  =  cost  of  learning  y.  when  y.  ,  y,  ,  etc.  are  known; 

yi|yjyk---yr  1  J  k 

K  =  cost  of  learning  y.  ,  y,  ,  etc.  simultaneously  when 

yiyj • • -yr  1  j 

none  of  the  observables  are  known  and  no  additional 
information  will  be  purchased. 

(If  we  allow  the  decision  maker  to  buy  sets  of  observables  simultaneously 
and  then  make  sequential  decisions  about  buying  more  information,  we  need 
to  define  even  more  prices  to  cover  all  of  the  possible  sequential  pur¬ 
chases  of  simultaneous  blocks  of  information.  The  situation  is  already 
complicated  enough,  so  we  will  only  allow  the  decision  maker  to  make  a 
single  simultaneous  purchase  with  no  prior  or  subsequent  purchases  of 
information.  We  would  also  have  more  prices  if  the  cost  of  an  observa¬ 
ble  depended  on  the  actual  value  of  the  observables,  as  it  might  if  we 
did  destructive  testing.  However  we  will  not  allow  this  type  of  price 
either.) 

It  is  easy  to  show  that  we  will  have  n2^°  ^  sequential  prices 
(including  K  ,...,K  ),  and  (2n-n-l)  simultaneous  prices,  when  there 

yi  yn 

f. 

are  n  observables.  Since  each  of  these  prices  represents  one  dimen-  f 

sion  of  the  price  diagram,  it  is  clear  that  we  cannot  hope  to  visualize 
the  decision  regions  even  when  there  are  only  two  or  three  observables. 

However,  having  a  large  number  of  prices  does  not  mean  that  we  cannot 
describe  the  decision  regions  algebraically.  We  can  determine  a  set  of 
inequalities  that  describe  each  decision  region  by  following  the  proce¬ 
dures  used  in  the  preceding  chapters. 


159 


The  expected  value  of  learning  5^  sequentially  when  we  are  trying 
to  maximize  expected  profit  and  the  prices  of  the  observables  are  not 
additive,  is 


/  T  l  •  •  •  i  "(’‘I . vc> 

max  |  E  max , 

\ J  max  (E  max  { . . . }  -  K  . 


Mi.j  yk 


MVj’J  '  y^ 


mCX  ¥,“'y  . Xm.C) 

C  X1  ^  1  m 


(This  is  not  equal  to  V  (K  i  i  )  or  V  (....K  i 

n  yibi’  yn|yi  yr  ’  yjta . 

\\yiy  »•••)  •)  When  we  consider  the  subspace  of  the  price  diagram 
spanned  by  »  Kyk|yiyj  »  etc,»  for  some  specific  values  of 

1  »  J  »  k  »  • • • >  we  are  able  to  draw  decision  boundaries  similar  to 
those  that  we  found  for  additive  prices.  However  the  decision  boundaries 
become  much  more  complicated  when  we  consider  all  of  the  dimensions  of 
the  price  diagram. 

The  decision  regions  can  be  simplified  if  we  restrict  the  prices 
of  the  observables  such  that  they  can  be  described  with  relatively  few 
numbers.  One  such  restriction  is  the  case  of  additive  prices.  Another 
way  to  restrict  the  prices  is  to  assume  that  the  i^  observable  costs 
Kv.  if  it:  is  the  first  piece  of  information  that  we  learn,  and  \  K 

yi  yt 

otnerwise.  The  reduction  factor  represents  the  savings  that  re¬ 

sult  from  having  previously  set  up  an  information-gathering  process  to 
learn  a  different  observable.  In  this  case  we  can  show  that  the  value 
of  learning  y^  sequentially,  when  we  are  trying  to  maximize  expected 
profit,  is 
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Wn . V  iKn- 1 -Vi+iNi+i . W 


max 


max  E  .  .  .  E  tt(x,  , . . .  ,x  ,c) 
c  H  x*  '  1’  m 


n^x  I  E  max  < 


max  E  . . .  E  tt(x,  , . . .  ,x  ,c) 
c  xi  V  1*  m 

max  (E  max{...}  -  X  K  ) 

Mij  yu  X  yk  i 


\\)\ 


-  max  E  ...  E  rr(x.,...,x  ,c) 
c  X1  'Sn  1  m 


The  corresponding  decision  boundaries  in  the  price  diagram  are  similar 
to  those  for  additive  prices,  except  they  are  stretched  along  the  ap¬ 
propriate  axes  by  amounts  equal  to  the  inverses  of  the  reduction  factors. 

There  are  obviously  many  other  ways  to  set  up  the  pricing  struc¬ 
ture.  Since  the  decision  rules  for  buying  information  depend  on  the 
prices  of  the  observables,  the  decision  rules  will  be  different  for 
each  price  structure.  In  some  cases  it  is  possible  to  visualize  the 
decision  rules  as  regions  in  a  price  diagram.  In  other  cases  the  large 
number  of  prices  will  preclude  any  graphical  representation  of  the  deci¬ 
sion  regions.  However,  as  the  previous  examples  have  shown,  the  method 
of  analysis  is  the  same  regardless  of  the  pricing  structure. 


Summary 

Under  certain  conditions  it  is  possible  to  extend  the  results  of 
the  previous  chapters  to  include  the  cases  of  uncertain  and  non-additive 
prices.  When  the  prices  of  the  observables  are  uncertain,  and  when  they 
are  independent  of  each  other  and  of  the  observables,  we  can  simply  re¬ 
place  the  price  of  each  observable  by  its  expected  value  in  the  decision 
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rules  for  certain  prices.  When  the  prices  are  not  independent,  it  is 
not  generally  possible  to  describe  the  decision  rules  in  terms  of  a 
finite  set  of  numbers.  However  we  can  still  use  the  appropriate  deci¬ 
sion  tree  to  determine  the  best  in  format  ion- purchasing  decision  if  we 
have  a  given  joint  probability  density  function  for  the  state  variables, 
the  observables,  and  their  prices. 

When  the  prices  of  the  observables  are  not  additive,  it  is  neces¬ 
sary  to  define  a  large  number  of  prices  to  include  all  of  the  possible 
ways  that  we  might  purchase  information.  Since  the  dimension  of  the 
price  diagram  equals  the  number  of  prices,  it  becomes  difficult  to 
visualize  the  decision  rules  for  purchasing  information.  However  these 
rules  are  still  determined  by  following  the  procedures  used  in  the 
previous  chapters. 

Even  in  the  cases  of  uncertain  and  non-additive  prices,  it  is  still 
true  that  the  expected  value  of  sequential  information  is  a  function  of 
the  prices  of  the  observables  or  our  state  of  information  about  the 
prices . 


APPENDIX  A 


THE  PROBABILITY  DENSITY  FUNCTION 
OF  THE  PROFIT  WITH  SEQUENTIAL  INFORMATION 

In  Chapter  2  we  assumed  that  the  profit  and  the  value  of  perfect 

information  were 'certain  quantities.  However  the  profit  and  the  value  of 

information  are  random  variables  since  they  are  functions  of  p  and  l  . 
N  R 

Let  TTp  ,  TTp  ,  and  tt  be  random  variables  equal  to  the  profit  when  we 

learn  the  actual  value  of  p  individually,  simultaneously,  and  sequen- 

N 

tially.  We  define  tt  to  be  the  profit  when  no  information  is  received, 
N 

an"  ”p  ^  to  be  the  profit  when  p  and  j t  are  learned  simultaneously. 

(None  of  these  random  variables  should  be  confused  with  tt(p,jfc,b)  ,  the 

profit  function.  As  before,  the  'uperscript  N  indicates  that  no 

information  will  be  purchased  other  than  that  shown  in  the  subscript.) 
t  „  N  R 

Let  vp  ,  vp  ,  and  vp  be  random  variables  equal  to  the  value  of  learn¬ 
ing  individual,  simultaneous,  and  sequential  information  about  p  .  R 
stands  for  the  residual  value  of  information  when  p  and  t  are  learned 
simultaneously.  The  expected  values  of  these  random  variables  are  VN  , 

R  P 

V"  ,  and  V  ,  respectively.  We  define  vN  to  be  the  value  of  learn- 
r  r  P  >  A 

i-n8  p  and  i  simultaneously.  The  expected  value  of  vN.  is  V* 

P  l  p  l 

We  can  determine  the  probability  density  function  for  each  of 

these  random  variables.  This  will  give  us  an  idea  of  the  risks  involved 

in  paying  to  learn  uncertain  information.  R.  A.  Howard  has  derived  the 

probability  density  functions  for  ,  rP  ,  vN  ,  ,  v^  ,  tP  and  vN 

P  P  *  *  p  *  £  p  * 

[3].  These  density  functions  or  "lotteries"  are  shown  in  Fig.  A.l.  As 
we  would  expect,  none  of  these  distributions  depends  on  the  prices  of 
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Figure  A. Id. 


Figure  A.le. 


perfect  information  about  any  of  the  state  variables. 


It  is  possible  to  derive  distributions  for  the  expected  profit  and 
the  value  of  perfect  information  when  the  information  is  obtained  se¬ 
quentially.  The  resulting  distributions  depend  on  the  prices  of  the 
observables  in  a  rather  complicated  manner.  To  illustrate  this  fact, 
consider  the  case  where  we  are  given  perfect  information  about  p  and 
then  have  the  option  of  paying  to  learn  j i  .  The  previous  calcula¬ 

tions  showed  that  the  value  of  perfect  information  and  the  expected 
profit  in  this  case  were  both  functions  of  K ^  .  The  expected  profit, 
when  we  are  given  perfect  information  about  p  ,  is  given  by 


{56/96  -  :  K£  £  1/8 

60/96  +  (4/3)K^2K£  -  2KX  :  1/8  <  K£  <  1/2 
28/96  .  1/2  <;  k£ 

To  find  the  probability  density  function  for  TT  ,  we  must  first 

P 

determine  our  optimum  bid  and  the  profit  for  every  possible  value  of  p 

and  L  .  When  we  have  TT  (p,X),  we  can  find  [tt  U}  ,  the  density  func- 

P  p 

tion  for  tt 
P 

In  our  previous  calculations  we  found  that  our  decision  to  pay 
to  learn  l  depends  on  the  values  of  p  and  .  There  were  three 
cases: 

(!)  If  Kjj  5  !/8  ,  we  should  always  pay  to  learn  l  regardless 

of  the  value  of  p  .  In  this  case  the  optimum  bid  is 


I  -  p  :  l  >  p 


l  £  p 


The  resulting  profit  as  a  function  of  p  ,  L  ,  and  K.  is 

Jv 


TT 


f  -  p  -  :  I  >  p) 


-K 


:  l  £  p 


This  profit  function  has  exactly  the  same  form  as  the  profit  func¬ 
tion  that  results  from  being  given  perfect  information  about  both 
p  and  l  simultaneously,  except  that  we  must  pay  in  the 

sequential  case.  Therefore  the  probability  density  function  for 
np  is  just  the  distribution  in  Fig.  A. If  for  the  profit  when  we 
are  given  perfect  information  about  both  p  and  l  ,  shifted  to 
the  left  by  .  This  distribution  is  shown  in  Fig.  A. 2,  anc  it 
is  given  by 


{rrp|&3  -  (1/4)  6<TTp+  K£)  +  (l/2)[u(np+  K^)  -  u(y  (1-K^)] 

+  [1  -  (tt  +  K£)/2]  [u(TTp-  (1-K^)  -  u(TTp-  (2-K^))] 


(  6(.)  is  the  unit  impulse  function.  u(.)  is  the  unit  step  function) 

(2)  If  1/8  <  <  1/2  ,  we  should  pay  to  learn  l  when 

0  5  P  5  2(1  -  \/2k^  )  .  Otherwise  we  should  not  pay  to  learn  l  . 

In  this  case  the  optimum  bid  is 


r. 


:  I  >  p  ,  0  £  p  £  2(1  - 

••  i  *  p  ,  o  *  P  *  2(1  -  yarpi 


Ll  +  p/2  :  2(1  -  >/2irp<  p  £  1 
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{n  Ik.  s  1/8,6) 
P  * 


profit  whan  we  are  given  perfect 
lnforaatlon  about  p  and  the  option 
to  buy  perfect  lnforaatlon  about  l 
for 


•'i  0 


Figure  A.2.  Probebility  density  function  for  profit  if  we  learn 
with  an  option  to  pay  Kj  for  t  (K^  s  1/8) 
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The  resulting  profit  as  a  function  of  p  ,  L  ,  and  K£  is 


P  -  K, 


TT 


-K, 

1  -  p/2 
0 


l  >  P  ,  0  s  p  5  2(1  ■  sPR ~) 


l  S  P  ,  0  S  p  s  2(1  -  v/Ik^-) 

1  +  p/2  <  £  ,  2(1  -  >/2K£  )  <  p  £  1 

i  +  p/2  *  jt  ,  2(1  -  s/irp  <  p  ^  1 


This  function  is  shown  in  Fig.  A. 3a.  Since  we  know  the  profit  as 
a  function  of  p  and  l  ,  and  since  we  know  the  joint  probability 
density  function  for  p  and  i  ,  we  can  carry  out  the  calcula¬ 
tions  necessary  to  find  the  probability  density  function  for  TTp  [3,14]. 
The  resulting  function  is 

(rrp  |&}  *  (2  -  K£  -  7/8)  6(t^)  +  (1  -  2  /5k “  +  2K ^  6(tt  +  K£) 


+  (1  -  m^)  [u(tt  +  K£)  -  u(n  -  (2  m~[-  K£))] 

+  (1  -  (TTp+  K£)/2)  [u(TTp-  (2v/2TJ"  -  K£)  -  u(TTp-  (2-K£))] 


+  TTp[u(TTp  -  1/2)  -  u(TTp  -  '/BTpi 


Tills  function  is  shown  in  Fig.  A- 3b. 

(3)  If  K£  ^  1/2  ,  we  will  never  pay  to  learn  L  ,  regardless  of  the 
value  of  p  .  In  this  cnse  the  optimum  bid  is 

b  =  1  +  p/2 

The  resulting  profit  as  a  function  of  p  and  l  is 

1  -  p/2  :  1  +  p/2  <  l 

I 

TT 

:  1  +  p/2  i  1 
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Figure  A. 3b.  Probability  density  function  for  profit  when  we  learn 
p  with  an  option  to  pay  for  £  (1/8  <K.  <  1/2) 


This  is  just  the  profit  that  we  would  achieve  by  learning  the 
actual  value  of  p  only.  Thus  the  resulting  probability  density 
function  is  the  distribution  in  Fig.  A. lb  for  the  profit  from 
learning  p  alone.  This  distribution  is  shown  in  Fig.  A. 4,  and 
it  is  given  by 

{TTpl&}  =  (5/8)  6(TTp)  +  TTp[u(np-  1/2)  -  u(np-  1)] 

Determining  the  expected  value  of  rrp  with  the  probability  density 
functions  in  Figs.  A. 2,  A. 3,  and  A. 4  yields  the  expressions  for  the  ex¬ 
pected  profit  that  we  found  previously. 

It  is  possible  to  use  the  same  procedure  to  find  the  probability 
density  function  for  the  value  of  perfect  information  about  p  , 
assuming  that  perfect  information  about  l  can  be  purchased  for  . 

It  is  also  possible  to  find  the  probability  density  functions  for  the 
value  of  information  and  the  expected  profit  when  we  are  given  perfect 
information  rbout  l  and  then  offered  perfect  information  about  p 
for  Kp  .  However  since  these  calculations  involve  no  new  concepts, 
they  are  not  included  here. 


Figure  A. 


0  1/2  1 


Probability  density  function  for  profit  when  we  learn  ‘f 
p  with  an  option  to  pay  Kj  for  l  (1/2 


172 


APPENDIX  B 


THE  WEATHER  FORECASTING  PROBLEM  IN  DETAIL 

In  Chapter  2  we  formulated  a  decision  problem  where  the  observa* 
bles  represent  imperfect  information.  The  problem  is  to  predict  the 
weather,  which  is  described  by  the  state  variable  x  .  The  probability 
mass  function  tor  x  is  shown  in  Fig.  3.1.  Having  forecast  the  weather, 
we  can  decide  to  set  up  an  activity  indoors  or  outdoors.  This  decision 
is  -epresented  by  the  control  variable  c  .  Setting  c  equal  to  zero 
is  equivalent  to  setting  up  the  activity  outdoors,  and  setting  c 
equal  to  one  is  equivalent  to  setting  up  the  activity  indoors.  The 
profit  function  is 

1  :  c  ■  x 

0  :  otherwise 

Two  weather  forecasts  are  available,  and  they  can  give  us  imperfect 

information  about  the  state  of  the  weather.  The  weather  forecasts  are 

described  by  two  observables,  yx  and  y2  .  If  yi  equals  one,  the 
th 

i  forecast  is  rain,  and  if  y^  equals  zero,  the  i  forecast  is  fair 
weather  (i=l,2)  .  Our  state  of  information  about  i^1  forecast  is  given 
by  the  conditional  probability  mass  function  in  Fig.  3.2. 

Since  we  have  decided  that  knowing  either  forecast  would  not  tell 
us  anything  about  the  other  forecast  when  we  know  the  actual  state  of 
the  weather,  y^  and  y2  must  be  conditionally  independent. 
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ly1,y2|x,fe}  =  {yjx.fc}  {y2|x,fe} 


36/100  :  x  =  yx  =  y2  ,  x  =  0,1 

24/100  :  x  =  1  -  yi  =  y2  ,  x  =  0,1 

24/100  :  x  =  yi  =  1  -  y2  ,  x  =  0,1 

16/100  :  x  =  1  -  yt  =  l  -  y2  ,  x  =  0,1 


0  :  otherwise 


In  the  following  discussion  we  will  also  need  to  know  several 
other  probability  mass  functions  that  can  be  derived  from  the  informa¬ 
tion  above  [14].  These  mass  functions  can  be  determined  easily  from  the 
probability  tree  shown  in  Fig.  B.l. 


tyj6}  =  E  fyjx>fe}  {x I &]  =<  8/15  :  yt  =  1  >  (i  =  1,2) 


7/15  :  y  =  0 


0  :  otherwise 


i. 

[yvy2\ti  -  E  lyi.y2kfe}  {*|s} 


68/500  :  yl  =  0  ,  y2  =  0 
77/300  :  yx  =  0  ,  y2  =  1 


2/300 


1  *  y2  =  o 


88/300  :  yl  =  1  ,  y  =  1 


otherwise 


117/3''  :  yt  =  0  ,  yj 

9/20  :  y.  =  0  ,  y. 

18/35  :  yt  -  1  ,  yj 

11/20  :  y±  =  1  ,  yj 

0  :  otherwise 


i.j  -  1,2 
i  *  j 


[x-l.yj-O.y^-Oli}  ■  32/300 


{x-l,yi-0,y2-l|«}  -  48/300 


{*-lf/l-l,y2-0|S}  ■  48/300 


{x-l,yi-l,y2-l|§}  ■  72/300 


Figure  B.l.  Probability  tree  for  weather- forece* ting  problem 


'  x| yt  ,&}  •-= 


{y± |x,&)  fx|*} 

lyj&i 


1/4  :  x  -  1  ,  yi  = 
3/4  :  x  -  1  ,  y.  = 


0  :  otherwise 


(i  =  1,2) 


{x|y1«y2.fe} 


{y1»y2lx»^}  Mt] 


iy1.y2l<? 


x  =  0  ,  -j1  =  0  ,  y, 
x  =  1  ,  y,  -  0  ,  y. 


x  =  0  ,  yl 

x  -  i  .  yi 
x  -  0  ,  yl 


o  .  y2 
0  ,  y2 
i  »  y-, 


x  -  l  ,  y,  =  i  ,  yr 


X  *  o  ,  yY 

x  -  1  ,  yl 

otherwise 


1  *  yl 
1  ,  y. 


We  can  use  this  information  to  cetermine  the  value  of  sequential  im 
perfect  information.  If  we  decide  not  to  pay  for  either  forecast,  our 
expected  profit  is 


max  E  tt(x,c) 


max  E 
c  x 


:  otherwise 


The  maximum  profit  occurs  when  we  set  c  equal  to  one,  or,  in  other 
words,  decide  to  set  up  the  activity  indoors. 

The  Values  of  Individual  and  Simultaneous  Information 


If  we  are  given  the  first  weather  forecasting  company's  prediction 


free  of  charge  and  do  not  intend  to  buy  the  second  forecast,  then  our 
expected  profit  after  learning  this  information  is 


D 

*1 


m?x  x  n(x’c) 


1 


y,  *  i 

otherwise 


J 


The  maximum  expected  profit  occurs  when  c  =  1  ,  or  when  we  set  up  the 
activity  indoors,  regardless  of  y^  .  Before  we  are  given  y^  our  ex¬ 
pected  profit  is 


4/7  :  yx  =  0 

E  mgx  g  tt(x.c')  =  ^  ^  3/4  :  yt  =  1  /►  = 

0  :  otherwise ) 


in 


Using  this  result  we  find  that  the  value  of  learning  the  first  company's 
forecast  by  itself  is 


max  E  -  max  E)  tt(x,c)  =  2/3  -  2/3  =  0 


The  fact  that  the  value  of  individual  information  about  y^  is 
zero  should  not  surprise  us.  Before  we  know  y^  our  best  decision  is 
to  set  up  the  activity  indoors,  and  after  we  learn  this  is  still 

the  best  decision.  Since  the  information  cannot  change  our  decision, 
the  value  of  the  information  is  zero. 

Exactly  the  same  reasoning  and  calculations  show  that  the  value  of 
individual  information  about  ,  the  second  company's  forecast,  is 
also  zero. 

VN  =  (E  max  E  -  max  E)  tt(x,c)  =  0 
y 2  y2  c  x  c  x' 
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As  before,  our  best  decision  is  to  set  up  the  activity  indoors 
regardless  of  what  the  second  weather  forecasting  company  thinks  the 
weather  is  going  to  be. 

If  we  are  given  both  weather  forecasts  simultaneously,  our  expected 
profit  after  learning  the  forecasts  is 


D  D  max  E  rr(x.c) 
y!  y2  C  X 


9/17 


o  ,  y,  = 


The  maximum  expected  profit  occui s  when 


In  other  words  we  should  set  up  outdoors  if  both  companies  forecast 
fair  weather,  and  stay  indoors  if  either  one  forecasts  rain.  This 
t^me  the  information  can  cause  us  to  change  our  decision  so  the  value 
of  learning  y^  and  simultaneously  will  be  positive. 

Before  we  are  given  the  two  weather  forecasts,  our  expected  profit 


is 


mgx  E  Tl(x,c) 


E 

yl 


9/17 

yl 

-  0  , 

y2 

-  0 

2/3 

yl 

-  o  , 

y2 

«=  1 

2/3 

yl 

-  1  , 

y2 

=  0 

9/11 

:  yl 

=  1  . 

y2 

=  1 

0 

:  otherwise 

/=  51/75 
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Using  this  result  we  find  that  the  \aiue  of  learning  both  weather 
forecasts  simultaneously  is 


VN  =  (E  E  max  E  -  max  E)  tt(x,c)  =  51/75  -  2/3  =  1/75 
yiy2  \y2  c  x  c  x 

Comparing  VN  with  VN  amd  V1*  ,  we  see  that  the  value  of 

yLy2  yi  y2 

learning  both  forecasts  simultaneously  does  not  equal  the  sum  of  the 
values  of  individual  information  about  the  two  forecasts.  In  general 

can  be  greater  or  less  than  the  sum  of  V  and  V  ,  in  exactly 

yiy2  yi  y2 

the  same  way  that  the  value  of  learning  two  pieces  of  perfect  informa¬ 
tion  can  be  greater  or  less  than  the  sum  of  the  values  of  individual 
perfect  information. 

Assume  that  the  two  weather  forecasts  y^  and  y2  can  be  pur¬ 
chased  for  prices  K  and  K  ,  respectively.  We  are  willing  to  pay 

Yl  2  N 

for  the  i^  weather  forecast  when  K  <  V  (i  =  1,2)  .  We  are  willing 

yi  yi 

N 

to  pay  for  both  forecasts  simultaneously  when  +  K^)  '  Vyiy2  1 

These  decision  rules  are  shown  graphically  in  Fig.  B.2.  Since 

and  v"  are  zero,  we  will  not  pay  to  learn  just  one  of  the  two  fore- 
y2 

casts.  However  learning  both  forecasts  might  change  our  decision  to 
set  up  the  activity  indoors,  so  there  are  pairs  of  prices  such  that  we 
are  willing  to  leain  y^  and  simultaneously.  These  pairs  of 

prices  are  represented  by  points  below  and  to  the  left  of  the  line  A-B 
in  Fig.  B.2. 

N  R 

We  can  use  V  to  define  two  related  quantities  V  (K  ) 

yiy2  yl  y2 

n  o 

and  V  (K  )  .  V  CK  )  is  the  residual  value  of  learning  y,  when 

y-i  yi  vi  y2  1 

we  must  buy  the  two  weather  forecasts  simultaneously.  We  define 


VR  (K  )  as  follows: 

yi  y2 


v„  (k  .  ) 


VN  -  K  =  1/75  -  K 
yly2  y2  y2 


We  are  willing  to  buy  both  pieces  of  information  simultaneously  when 


K 


y 


1 


< 


) 

2 


This  is  the  same  decision  rule  as  the  one  shown  in  Fig.  B.2.  In 
exactly  .he  same  way,  the  residual  value  of  information  about  y ^ 
is  defi.ied  to  be 


VR  (K  )  =  VN  -  K  =  1/75  -  iC 


y2  yl 


yly2  yl 


We  are  willing  to  buy  both  pieces  of  information  simultaneously  when 


K  <  V  (K  ) 
y2  y2  yl 


The  Value  of  Sequential  Information 

Now  consider  the  situation  where  the  two  weather  forecasts  can 
be  purchased  sequentially.  Assume  for  a  moment  that  we  already  know 
the  first  forecast  and  we  are  trying  to  decide  whether  or  not  to  pay  for 
the  second.  How  much  is  the  second  piece  of  information  worth  to  us? 

If  we  decide  not  to  learn  the  second  forecast,  then  our  expected 
profit  as  a  function  of  y^  is 


D  max  E  TT(x,c) 

yl  c  x 


The  maximum  expected  profit  occurs  when  c  =  1  .  On  the  other  hand,  if 
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we  decide  to  learn  the  second  weather  forecast,  the  expected  profit  as 
a  function  of  y^  is 


D  E  max  E  tt(x,c) 
yl  y2  C  X 


yl  =  0  1 

yl  =  1  > 

otherwise  I 


The  maximum  profit  occurs  when 


The  increase  in  expected  profit  caused  by  learning  y2  ,  when  we  al¬ 
ready  know  yl  ,  is  the  difference  between  the  two  expressions  above. 


(f2  mtx  £  -  T*  £>  TT<X*C> 


Now  suppose  that  the  price  of  the  second  company's  weather  fore¬ 
cast  is  Ky^  .  We  should  pay  this  price  for  the  forecast  when  the  in¬ 
crease  in  expected  profit  exceeds  ;  otherwise  we  should  not  buy 

the  information.  Thus  we  should  pay  for  the  second  forecast  when 


Ky2  <  F/fj  "?x  I  '  wgx  p 

This  decision  rule  is  shown  in  Fig.  B.3.  It  is  obvious  from  the  in¬ 
equality,  or  from  Fig.  B.3,  that  for  certain  values  of  K  the  deci- 

y2 

sion  to  buy  or  not  buy  information  about  y2  depends  on  y^  ,  the 

forecast  we  learned  earlier.  There  are  two  cases; 

(i)  If  Ky  <  1/35  ,  we  may  or  may  not  pay  K  to  learn  y,  , 

2  2 
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D 

yi 


(E  max  E  - 


raP  5>  "<X,c) 


j 

buy 

information 


do  not  buy 
Information 


Figura  B.3. 


‘u'K"1  Pr°flt 
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depending  on  the  value  o'  yx  .  We  will  pay  to  learn  y. 


when 


1/35 


yl  "  0 


K  < 


0  :  otherwise 


or,  in  other  words,  when  v  =  n  ., 

’  wnen  yx  -  0  .  Thus  the  expected  profit  as 


function  of 


is 


y2  m§x  |  tt(x,c)  -  K 


D  max 
yl 


m§x  E  tt(x,c) 


y2 


°1  ?2  "T*  I  TT<X-C)  -  *  :  yi  -  0 


y2 


.?!  m?x  5  n<x.c) 


yi  -  1 


3/5  -  K_  :  yj  «  o 


y2 


3/4 


:  yl 


(2)  If  a  1/35  ,  we  will  never  pay  to  learn  ,  regardless 

of  the  value  of  ,  because  will  alwavs  exceed  the  Increase 

in  the  expected  profit.  In  this  case,  the  expected  profit  as  a 
function  of  y^  is 


yx  mcx  £  n<x.c) 


4/7  :  y^  ■  o 


i  3/4  :  yx  *  1 

These  equations  give  us  the  expected  profit  as  a  function  of  y 

“d  \  •  T°  tInd  the  K*«ted  profit  before  we  learn  ^  we  need  to 
lake  the  expected  value  with  respect  to  ^  of  the  previous  results. 
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Thus  our  expected  profit  when  we  learn  that  we  will  be  given  the  first 
weather  forecast,  but  before  we  receive  the  information,  is 


E  max 

yi 


E  max  E  (x,c)  -  K 
y  2  c  x  y  2 


max  E  (x , c ) 
c  x  v  ’  ' 


51/75  -  (7/15)K  :  K  <  1/35 

y2  y2 


:  K  s  1/35 
y2 


Since  our  expected  profit  without  any  information  is  max  E  nfx  c) 

c  x  ’ 

we  must  subtract  this  quantity  from  the  result  above  to  get  the  value 

of  sequential  information  about  the  first  weather  forecast  V  (K  ) 

yl  y2 


V  (K  )  =  E  max 
yl  y2  yl 


E  max  E  tt(x,c)  -  K 
y2  e  x  y  2 


max  E  rr(x,c) 


1/75  -  (7/15)K  :  K  <  1/35 

y2 


:  K  *  1/35 
y2 


-  max  E  tt(x  ,  c ) 
c  x  v  *  ' 


If  we  are  offered  the  first  weather  forecast  for  K  ,  wc  will 

yl 

accept  the  offer  when  K  <  V  (K  )  .  However  V  depends  on  K  , 

yl  yl  y2  yi  y2 

so  we  must  know  both  K  and  K  before  we  can  decide  whether  or 

yl  y2 

not  to  pay  for  the  first  forecast.  In  terms  of  K  and  K  we 

yl  y2 

should  pay  K  for  the  first  weather  forecast  when 


K  < 

yl 


1/75  -  (7/15)K  :  K  <  1/35  J 

y2  y2  I 

0  :  K  s  1/35  I 

y2  J 


This  decision  rule  is  shown  graphically  in  Fig.  3.3.  We  are  willing  to 
Pay  to  learn  the  first  weather  forecast  for  any  pair  of  prices 

represented  by  a  p^int  below  the  line  A-E-D. 
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Since  our  initial  state  of  information  is  completely  symmetrical 
with  respect  to  the  two  weather  forecasting  companies,  the  calculation 
to  determine  the  value  of  sequential  information  about  the  second  weather 
forecast  y2  looks  like  the  calculation  above  with  the  subscripts 
changed.  We  start  by  assuming  that  we  know  the  second  forecast,  and 
ask  how  much  it  would  be  worth  to  also  learn  the  first  forecast.  Fol¬ 
lowing  the  same  reasoning  as  before,  we  find  that  the  value  of  sequen¬ 


tial  information  about 


the 


E 

yi 


second  forecast  is 

max  E  tt(x,c)  -  K 
ex'  yi 


(K  ) 

yi 


E  max 

y2 


max  E  tt(x,c) 


mgx  E  rr(x,c) 


1/75  -  (7/15)Kyi  s  K  <  1/35 


K  *  1/35 
yl 


We  are  willing  to  pay  Ky^  to  learn  the  second  forecast  when  < 

V  (K  )  .  This  decision  rule  is  shown  in  Fig.  3.3.  We  are  willing  to 

y2  yi 

pay  Ky  to  learn  y2  for  any  pair  of  prices  represented  by  a  point 
to  the  left  of  the  line  B-E-C. 

The  Relative  Values  of  Vy^  ,  V^(Ky^)  ,  and  Vy^(Ky^) 

Thus  we  should  be  willing  to  pay  for  one  of  the  two  pieces  of  im¬ 
perfect  information  if  we  are  offered  any  pair  of  prices  represented 
by  a  point  below  or  to  the  left  of  the  boundary  C-E-D  in  Fig.  3.3.  This 
set  of  price  pairs,  which  we  call  the  set  of  feasible  prices,  includes 
all  of  the  feasible  pairs  of  prices  that  we  found  previously  by  con¬ 
sidering  individual  and  simultaneous  information.  Using  the  equations 
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derived  above,  we  can  show  that  this  must  always  be  the  case.  If  we 
only  buy  one  of  the  two  forecasts  by  itself,  then  the  value  of  the 
information  is 

N 

vv  max  E  rr(x,c)  -  max  E  n(x,c)  (i  =  1,2) 

J  i  J  ^  ^  x  CX 

If  we  buy  both  forecasts  simultaneously,  then  the  value  of  the  informa¬ 
tion  is 


Vy  <Ky  >  "  $  (f 

yi  yi  yj 


max  E  TT(x,c)  -  K  )  -  max  E  tt(x,c) 


C  X 


C  X 


(i,j  =  1,2) 
(1  *  j) 


If  we  buy  forecasts  sequentially  the  value  of  the  information  is 


V  (K  )  =  E  max* 
yi  yj  yi 


E  max  E  TT(x,c)  -  K 
yj  c  x  yj 


max  E  tt(x,c) 


-  max  E  tt(x , c) 


(i,j  =  1,2) 


(i  *  j) 


From  the  form  of  these  equations  we  can  show  that  V  (K  )  must  be 

yi  yj 

NR  J 

at  least  as  large  as  Vy^  or  Vy^CKy^)  for  any  value  of  Ky^  and 

for  i,j  •  1,2  ;  i  ?  ]  .  Obviously,  for  any  value  of  Ky^  : 


max 


D  E  max  E  n(x,c)  -  K 
>’i  yj  c  x  y 1 


max  E  n(x,c) 


2:  D  E  max  E  n(x,c)  -  K 
yt  yj  c  x  j 


max 


rD 

y 


E  max  E  n(x,c) 
yt  yj  c  x 


D  max  E  n(x,c) 
v.yi  c  x 


^  D  max  E  rr(x,c) 
y^  c  x 


(i,j  -  1,2) 


(i  *  j) 


Taking  the  expected  value  with  respect  to  y^  and  subtracting 
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from  both  sides  of  the  inequalities  ,ifcld 


max  E  nCx.c) 

C  X 


J  (K  )  2  V  (K  ) 

yt  yj  yt  yj 


V 

yi 


)  *  v 


N 

yi 


(i,j  -  1,2 
(i  *  j) 


Decision  Regions  in  the  Price  Diagram 

Figure  3.3  shows  the  pairs  of  prices  for  which  we  are  willing  to  pay 
for  one  of  the  forecasts,  but  it  does  not  show  which  forecast  to  buy 
first.  If  we  decide  to  buy  a  forecast,  we  would  expect  the  best  one  to 
buy  first  to  be  the  one  that  is  least  expensive,  due  to  the  symmetry  of 
the  problem.  A  quick  calculation  shows  that  our  intuition  is  correct. 
Since  we  are  trying  to  maximize  our  expected  profit,  and  since  the  in¬ 
crease  in  expected  profit  is  the  difference  between  '•.he  value  and  the 
cost  of  the  information,  we  should  pay  for  yx  first,  when 


)  -  K 


V  (K  ) 
y2  yl 


K 


E  max 
yi 


E  max  E  tt(x,c) 

y0  c  x 


max  E  tt(x,c) 
c  x 


max  E  rr(x,c)  -  K 
x  c 


>  E  max 
y? 


E  max  E  n(x,c)  -  K 


max  E  TT(x,c) 
c  x 


m.- E  tt(x,c)  -  K 
c  x  y 


For  the  weather  forecasting  problem,  this  becomes 
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y2  yx 


1/75  -  (7/15)K,  -  K 
-  K 

yi 


K  <  1/35 


’1 


:  K  *  1/35 
*2 


1/75  -  (7/15)K  -  K  :  K  <  1/35 


yi  y2  yx 


K 


:  \  >  1/35 


In  addition  we  will  only  pay  for  y,  when  V  (K  )  >  K  .  These 

1  yl  y2 

inequalities  define  the  decision  regions  shown  in  Fig.  3.4. 

Character  zing  the  Decision  Regions 

The  expected  value  of  either  forecast  can  vary  with  the  price  of 
the  other  forecast,  as  shown  in  Fig.  3.4.  If  we  consider  only  the 
region  in  Fig.  3.4  where  our  best  initial  decision  is  to  buy  information 
about  y^  ,  we  can  see  that  we  would  be  willing  to  pay  significantly 
more  to  learn  y^  when  we  subsequently  have  the  option  to  buy  the  sec¬ 
ond  weather  forecast.  In  fact,  without  the  option  to  buy  the  second 
weather  forecast,  the  first  forecast  is  worthless.  When  we  can  subse¬ 
quently  purchase  the  second  forecast  and  when  we  restrict  our  attention 
to  those  pairs  of  prices  where  our  best  initial  decision  is  to  buy  in¬ 
formation  about  y^^  ,  the  first  forecast  can  be  worth  as  much  as  the 

K  component  of  the  point  E  in  Fig.  3.4.  Although  there  are  other 
yl 

pairs  of  prices  for  which  we  would  be  willing  to  pay  more  to  learn  y^ 
first  than  we  would  at  the  pair  of  prices  corresponding  to  the  point  E, 
we  could  increase  our  expected  profit  more  by  first  paying  for  y2 
instead  of  y^  .  Thus  the  maximum  amount  that  we  would  pay  to  learn 
y^  first  is  the  K  component  of  the  point  E  .  Exactly  the  same 
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reasoning  sb^ws  that  the  maximum  amount  that  we  would  pay  to  learn  y2 
first  is  the  component  of  the  point  E  . 

One  way  to  characterize  the  decision  regions  in  Fig.  3.4  is  to 
determine  the  maximum  amount  that  we  would  be  willing  to  pay  initially 
for  each  piece  of  information.  Since  we  are  dealing  with  imperfect 
information,  we  could  bound  the  value  of  the  weather  forecasts  by  find¬ 
ing  the  expected  value  of  perfect  information  about  the  weather.  For 
the  weather  forecasting  problem  this  is  easy  to  do  since  the  profit 
depends  on  only  one  state  variable, 

VN  =  (max  E  -  E  max)  ir(x,c)  =  1  -  2/3  =  1/3 

X  C  X  X  c 

However  we  can  see  from  Fig.  3.4  that  this  is  not  a  very  tight  upper 
bound.  (If  the  profit  depends  on  more  than  one  state  variable,  we 
must  use  the  techniques  introduced  in  Chapter  2  to  find  an  upper 
bound  for  the  expected  value  of  perfect  information.) 

A  better  upper  bound  on  the  value  of  imperfect  sequential  informa¬ 
tion  is  given  by  the  maximum  amount  that  we  would  pay  initially  for 
each  piece  of  information,  corresponding  to  the  coordinates  of  the 
point  E  in  Fig.  3.4.  We  can  extend  the  results  of  the  preceding  chap¬ 
ter  to  the  case  of  imperfect  information  and  develop  an  iterative 
procedure  for  finding  the  coordinates  of  the  point  E  when  there  are 
only  two  observables.  Suppose  we  first  determine  the  value  of  indi¬ 
vidual  information  about  y.  and  y„  .  This  gives  us  V1*  and  V1*  . 

12  yi  Y2 

which  are  both  zero  in  the  weather  forecasting  problem.  In  Fig.  3.4, 

this  pair  of  values  is  represented  by  a  point  at  the  origin.  Now  use 
N  N 

V  and  V"  as  the  prices  K  and  K  in  the  decision  tree 

yi  y2  yi  yi 
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tranches  in  Fig.  3- 5b.  Solving  the  decision  tree  for  the  expected 
profits  associated  with  branches  and  (the  branches  where  we 

first  learn  and  y ^  ,  respectively),  and  then  subtracting  the  ex¬ 

pected  profit  associated  with  branch  Bq  (the  branch  where  we  do  not 
buy  any  information),  yields  the  values  of  sequential  information  about 

y,  and  y„  when  the  cost  of  information  is  given  by  and 

12  ?1 
Figure  B.4a  shows  that  the  values  of  information  produced  by  this  calcu¬ 
lation  correspond  to  the  coordinates  of  the  point  F  . 

Now  repeat  the  procedure  by  using  the  coordinates  of  the  point  F 
in  Fig.  B.4a  as  the  prices  K  and  K  in  the  decision  tree  branches 

yi  y2 

in  Fig.  3.5b.  Solving  for  the  expected  profits  associated  with  branches 
B^  and  B£  ,  and  then  subtracting  the  expected  profit  associated  with 
branch  Bq  ,  yields  two  new  values  of  information.  Figure  B.4b  shows 
that  these  new  values  are  the  coordinates  of  the  point  G  .  The  proce¬ 
dure  can  be  continued  by  using  the  coordinates  of  the  point  G  in  the 
decision  tree  to  get  another  point  that  is  even  closer  to  the  point  E  . 

While  this  procedure  will  give  us  a  series  of  points  in  the  price 
diagram  that  converge  to  the  point  E  ,  it  is  not  necessary  to  carry 
out  repeated  solutions  of  the  decision  tree  in  Fig.  3.5  to  find  upper 
bounds  for  the  values  of  information  about  y^  and  y^  .  The  first 
iteration  using  V  and  in  the  decision  tree  is  all  that  is 

yi  y2 

necessary  to  determine  the  upper  bounds.  Chapter  4  shows  that,  when¬ 
ever  there  are  only  two  observables,  the  point  F  must  lie  above  and 
to  the  right  of  the  point  E  if  it  does  not  coincide  with  the  point  E  . 
Thus  the  coordinates  of  the  point  F  must  be  at  least  as  large  as  the 
coordinates  of  the  point  E  ,  which  in  turn  must  be  at  least  as  large 
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Therefore  the  coor- 


as  the  values  of  information  about  y^  and  y ^  • 
dinates  of  the  point  F  are  an  upper  bound  for  the  value  of  the  imper¬ 
fect  weather  forecasts. 

An  interesting  feature  of  the  weather  forecasting  problem  is  that 
both  of  the  coordinates  of  the  point  F  in  Fig.  B.4  are  equal  to 
VN  .  This  follows  from  the  fact  that  and  are  both  zero. 

yiy2  yi  y2 

When  we  solve  the  decision  tree  in  Fig.  3.5  with  all  of  the  prices  set 
equal  to  zero,  it  is  obvious  that  the  resulting  value  of  information 
about  any  observable  will  be  the  value  of  learning  all  of  the  observ¬ 
ables  simultaneously.  No  matter  which  observable  we  decide  to  learn 
first,  we  will  subsequently  decide  to  learn  the  other  observable  be¬ 
cause  it  is  free.  Chapter  4  shows  that  the  value  of  learning  all  of 
the  observables  simultaneously  is  always  an  upper  bound  for  the  value 
of  sequential  information  about  any  of  the  observables,  even  when  there 
are  more  than  two  observables. 
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